Max level shown:
1 [ Dec 20 21:10:08 Enabled. ]
2 [ Dec 20 21:10:08 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 20 21:10:08 Method "start" exited with status 0. ]
4 [ Dec 20 21:10:08 Rereading configuration. ]
5 [ Dec 20 21:10:08 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-20T21:10:08.477ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-20T21:10:08.477ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-20T21:10:08.529ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-20T21:10:08.530ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-20T21:10:08.646ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-20T21:10:08.654ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-20T21:10:08.663ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-20T21:10:09.266ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-20T21:10:09.405ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-20T21:10:09.405ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-20T21:10:09.405ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-20T21:10:09.405ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-20T21:10:09.405ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-20T21:10:09.405ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-20T21:10:09.408ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-20T21:10:09.408ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-20T21:10:09.408ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-20T21:10:09.408ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-20T21:10:09.408ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-20T21:10:09.408ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-20T21:10:09.408ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-20T21:10:09.408ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-20T21:10:09.408ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-20T21:10:09.420ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-20T21:10:09.420ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = c5b1517f-af84-4f35-9630-726554609cf4 (zpool)
322024-12-20T21:10:09.515ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal }
332024-12-20T21:10:09.867ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-20T21:10:09.867ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-20T21:10:09.867ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-20T21:10:09.867ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-20T21:10:09.867ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-20T21:10:09.867ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-20T21:10:09.867ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-20T21:10:09.875ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-20T21:10:09.875ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool)
422024-12-20T21:10:09.959ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal }
432024-12-20T21:10:10.309ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-20T21:10:10.309ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-20T21:10:10.309ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482024-12-20T21:10:10.309ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-20T21:10:10.309ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-20T21:10:10.309ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-20T21:10:10.309ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
532024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-12-20T21:10:10.309ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-20T21:10:10.309ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-20T21:10:10.309ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-20T21:10:10.309ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
582024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-12-20T21:10:10.309ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-12-20T21:10:10.309ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-20T21:10:10.309ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-20T21:10:10.309ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
642024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
652024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
662024-12-20T21:10:10.309ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-12-20T21:10:10.309ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-20T21:10:10.309ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-20T21:10:10.309ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722024-12-20T21:10:10.309ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-20T21:10:10.309ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-20T21:10:10.309ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-20T21:10:10.309ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782024-12-20T21:10:10.309ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-20T21:10:10.309ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-20T21:10:10.309ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812024-12-20T21:10:10.309ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-12-20T21:10:10.309ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-12-20T21:10:10.309ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-20T21:10:10.309ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872024-12-20T21:10:10.309ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-20T21:10:10.309ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-12-20T21:10:10.309ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-12-20T21:10:10.309ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932024-12-20T21:10:10.309ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-20T21:10:10.309ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-20T21:10:10.309ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-20T21:10:10.309ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-20T21:10:10.309ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002024-12-20T21:10:10.309ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-12-20T21:10:10.309ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-12-20T21:10:10.309ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-20T21:10:10.309ZINFOSledAgent (bootstore): No ledger in /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-20T21:10:10.310ZINFOSledAgent (bootstore): No ledger in /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-20T21:10:10.310ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-20T21:10:10.310ZINFOSledAgent (bootstore): No ledger in /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-20T21:10:10.310ZINFOSledAgent (bootstore): No ledger in /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-20T21:10:10.310ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-20T21:10:10.310ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-20T21:10:10.310ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-20T21:10:10.321ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132024-12-20T21:10:10.321ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1130, tv_nsec: 169061191 } time_to_next_cleanup = 599.999924388s
1142024-12-20T21:10:10.321ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1152024-12-20T21:10:10.321ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1162024-12-20T21:10:10.321ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-20T21:10:10.321ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-20T21:10:10.324ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-20T21:10:10.326ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-20T21:10:10.326ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-20T21:10:10.326ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-20T21:10:10.326ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232024-12-20T21:10:10.326ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242024-12-20T21:10:10.326ZINFOSledAgent (RSS): No ledger in /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-20T21:10:10.326ZINFOSledAgent (RSS): No ledger in /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-20T21:10:10.326ZINFOSledAgent (RSS): No ledger in /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-20T21:10:10.326ZINFOSledAgent (RSS): No ledger in /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-20T21:10:10.326ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-20T21:10:10.326ZINFOSledAgent (RSS): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-20T21:10:10.327ZINFOSledAgent (RSS): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-20T21:10:10.327ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-20T21:10:10.327ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-20T21:10:10.327ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-20T21:10:10.327ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-20T21:10:10.327ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-20T21:10:10.327ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-20T21:10:10.327ZINFOSledAgent (bootstore): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-20T21:10:10.327ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-20T21:10:10.327ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 9ab49b39-4891-4f63-9152-18cfc9c75d04 (sled), rack_id: 19e96990-2b5d-4cc7-a5f5-981b28881f94, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-20T21:10:10.328ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1412024-12-20T21:10:10.328ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1422024-12-20T21:10:10.332ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-20T21:10:10.338ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-20T21:10:10.339ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-20T21:10:10.343ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-20T21:10:10.343ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-20T21:10:10.343ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:64707
1482024-12-20T21:10:10.343ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 9ab49b39-4891-4f63-9152-18cfc9c75d04 (sled), rack_id: 19e96990-2b5d-4cc7-a5f5-981b28881f94, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-20T21:10:10.343ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-20T21:10:10.343ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-20T21:10:10.343ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-20T21:10:10.343ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532024-12-20T21:10:10.343ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542024-12-20T21:10:10.343ZINFOSledAgent (StorageManager): No ledger in /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-12-20T21:10:10.343ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562024-12-20T21:10:10.343ZINFOSledAgent (StorageManager): No ledger in /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-20T21:10:10.343ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582024-12-20T21:10:10.343ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592024-12-20T21:10:10.343ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602024-12-20T21:10:10.343ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-20T21:10:10.343ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622024-12-20T21:10:10.359ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632024-12-20T21:10:10.380ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-20T21:10:10.396ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-20T21:10:10.425ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
1662024-12-20T21:10:10.425ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672024-12-20T21:10:10.425ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
1682024-12-20T21:10:10.425ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-20T21:10:10.428ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 139.694806ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d9571dc6-3335-4470-a89c-a46b0c128015", "content-length": "124", "date": "Fri, 20 Dec 2024 21:10:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d9571dc6-3335-4470-a89c-a46b0c128015" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-20T21:10:10.438ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_c5b1517f-af84-4f35-9630-726554609cf4/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-20T21:10:10.461ZINFOSledAgent: successfully created encrypted zvol: name="oxi_c5b1517f-af84-4f35-9630-726554609cf4/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-20T21:10:10.461ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_c5b1517f-af84-4f35-9630-726554609cf4/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-20T21:10:10.466ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
1742024-12-20T21:10:10.466ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752024-12-20T21:10:10.466ZINFOSledAgent (BackingFs): Ensuring dataset oxi_c5b1517f-af84-4f35-9630-726554609cf4/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762024-12-20T21:10:10.548ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772024-12-20T21:10:10.569ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782024-12-20T21:10:10.570ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 63.178064ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3f66ed5f-eba7-4028-bd01-01c2f175826d", "content-length": "124", "date": "Fri, 20 Dec 2024 21:10:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3f66ed5f-eba7-4028-bd01-01c2f175826d" } file = clients/ddm-admin-client/src/lib.rs:177
1792024-12-20T21:10:10.634ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-20T21:10:10.634ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 117.667842ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4b3153bf-18c1-4e8a-99f7-a047c1b33497", "content-length": "124", "date": "Fri, 20 Dec 2024 21:10:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4b3153bf-18c1-4e8a-99f7-a047c1b33497" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-20T21:10:10.753ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-12-20T21:10:10.753ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 192.282987ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dc2c6470-af96-48ec-ad6d-5b0c06b91130", "content-length": "124", "date": "Fri, 20 Dec 2024 21:10:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dc2c6470-af96-48ec-ad6d-5b0c06b91130" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-12-20T21:10:10.767ZINFOSledAgent (BackingFs): Mounting oxi_c5b1517f-af84-4f35-9630-726554609cf4/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842024-12-20T21:10:10.781ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852024-12-20T21:10:10.781ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862024-12-20T21:10:10.781ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872024-12-20T21:10:10.781ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882024-12-20T21:10:10.947ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-20T21:10:10.948ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 178.783743ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "80e01a06-1909-42b7-9d5f-fbc26b1ac449", "content-length": "124", "date": "Fri, 20 Dec 2024 21:10:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "80e01a06-1909-42b7-9d5f-fbc26b1ac449" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-20T21:10:11.128ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-20T21:10:11.128ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 342.874782ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c226fed9-7b02-4941-934c-e98a4483e658", "content-length": "124", "date": "Fri, 20 Dec 2024 21:10:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c226fed9-7b02-4941-934c-e98a4483e658" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-20T21:10:11.473ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-20T21:10:11.473ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 347.662892ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f07a8e7e-2404-452d-88d5-81060971bf28", "content-length": "124", "date": "Fri, 20 Dec 2024 21:10:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f07a8e7e-2404-452d-88d5-81060971bf28" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-12-20T21:10:11.523ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
1952024-12-20T21:10:11.528ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:64338 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
1962024-12-20T21:10:11.528ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
1972024-12-20T21:10:11.528ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:64338 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
1982024-12-20T21:10:11.530ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 250.259283ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
1992024-12-20T21:10:11.531ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2002024-12-20T21:10:11.531ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2012024-12-20T21:10:11.531ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2022024-12-20T21:10:11.531ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-12-20T21:10:11.781ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 490.948701ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2042024-12-20T21:10:11.822ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2052024-12-20T21:10:12.274ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 642.867123ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2062024-12-20T21:10:12.919ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.266529879s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2072024-12-20T21:10:14.066ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2082024-12-20T21:10:14.066ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2092024-12-20T21:10:14.066ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2102024-12-20T21:10:14.066ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2112024-12-20T21:10:14.066ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2122024-12-20T21:10:14.066ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2132024-12-20T21:10:14.068ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2142024-12-20T21:10:14.069ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2152024-12-20T21:10:14.070ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='e047b563-4855-4b12-a721-2b7edc625e68'/> <propval type="astring" name="rack_id" value='19e96990-2b5d-4cc7-a5f5-981b28881f94'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe61:692f'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='19e96990-2b5d-4cc7-a5f5-981b28881f94'/> <propval type="astring" name="sled_id" value='9ab49b39-4891-4f63-9152-18cfc9c75d04'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='9ab49b39-4891-4f63-9152-18cfc9c75d04'/> <propval type="astring" name="rack_uuid" value='19e96990-2b5d-4cc7-a5f5-981b28881f94'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='9ab49b39-4891-4f63-9152-18cfc9c75d04'/> <propval type="astring" name="rack_uuid" value='19e96990-2b5d-4cc7-a5f5-981b28881f94'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-12-20T21:10:14.070ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-12-20T21:10:14.187ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.331773625s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2182024-12-20T21:10:14.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 37.998731ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-20T21:10:14.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 99.732528ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-20T21:10:14.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 243.770158ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-20T21:10:15.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 262.170985ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-20T21:10:15.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 487.691826ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-20T21:10:16.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.340644085s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-20T21:10:17.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 849.035071ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-20T21:10:18.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.399265702s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-20T21:10:19.522ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.350481198s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2272024-12-20T21:10:20.485ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/9ab49b39-4891-4f63-9152-18cfc9c75d04) file = sled-agent/src/nexus.rs:527 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2282024-12-20T21:10:20.516ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2292024-12-20T21:10:20.516ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2302024-12-20T21:10:20.517ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312024-12-20T21:10:20.517ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322024-12-20T21:10:20.517ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2332024-12-20T21:10:20.517ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-20T21:10:20.517ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-12-20T21:10:20.518ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362024-12-20T21:10:20.518ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372024-12-20T21:10:20.518ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2382024-12-20T21:10:20.518ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:64707
2392024-12-20T21:10:20.695ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2402024-12-20T21:10:20.695ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2412024-12-20T21:10:20.701ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422024-12-20T21:10:20.701ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2432024-12-20T21:10:20.701ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442024-12-20T21:10:20.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57587
2452024-12-20T21:10:20.964ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462024-12-20T21:10:20.964ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2472024-12-20T21:10:20.964ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-zones.json file = common/src/ledger.rs:188
2482024-12-20T21:10:20.964ZINFOSledAgent (ServiceManager): No ledger in /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-zones.json file = common/src/ledger.rs:188
2492024-12-20T21:10:20.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57587 req_id = 0f563581-037a-4438-b743-000e3aa0fe29 response_code = 200 uri = /inventory
2502024-12-20T21:10:20.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39985
2512024-12-20T21:10:20.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39985 req_id = 9eed44cb-b9e4-4379-a3ee-872e1bef8252 response_code = 200 uri = /sled-role
2522024-12-20T21:10:21.025ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 20d1bbc5-907b-485f-a0cc-7d5420416467 (physical_disk), pool_id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 27da5a72-852f-4da0-855b-5ac595d024a3 (physical_disk), pool_id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 530650a6-ac7a-4359-9dd1-e0b91cef4e1e (physical_disk), pool_id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: dbbd83a3-64d2-4625-90f3-2d310d050cc7 (physical_disk), pool_id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b56fdea4-d3ab-402b-9c60-4cef7ba042d8 (physical_disk), pool_id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: bc641dc7-35f4-4a70-834c-d8119630673b (physical_disk), pool_id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6ef92501-774e-4e3f-84ba-0690d23f90cc (physical_disk), pool_id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1b84024f-2317-451c-94df-d839d967baae (physical_disk), pool_id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 1a3a5a6a-b060-4b42-a869-05bd10340148 (physical_disk), pool_id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2532024-12-20T21:10:21.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47724
2542024-12-20T21:10:21.025ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2552024-12-20T21:10:21.025ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 20d1bbc5-907b-485f-a0cc-7d5420416467 (physical_disk), pool_id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 27da5a72-852f-4da0-855b-5ac595d024a3 (physical_disk), pool_id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 530650a6-ac7a-4359-9dd1-e0b91cef4e1e (physical_disk), pool_id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: dbbd83a3-64d2-4625-90f3-2d310d050cc7 (physical_disk), pool_id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b56fdea4-d3ab-402b-9c60-4cef7ba042d8 (physical_disk), pool_id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: bc641dc7-35f4-4a70-834c-d8119630673b (physical_disk), pool_id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6ef92501-774e-4e3f-84ba-0690d23f90cc (physical_disk), pool_id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1b84024f-2317-451c-94df-d839d967baae (physical_disk), pool_id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 1a3a5a6a-b060-4b42-a869-05bd10340148 (physical_disk), pool_id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2562024-12-20T21:10:21.025ZINFOSledAgent (StorageManager): No ledger in /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572024-12-20T21:10:21.026ZINFOSledAgent (StorageManager): No ledger in /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582024-12-20T21:10:21.026ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2592024-12-20T21:10:21.026ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2602024-12-20T21:10:21.026ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2612024-12-20T21:10:21.026ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2622024-12-20T21:10:21.026ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2632024-12-20T21:10:21.159ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2642024-12-20T21:10:21.159ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool)
2652024-12-20T21:10:21.587ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9ab49b39-4891-4f63-9152-18cfc9c75d04) file = sled-agent/src/probe_manager.rs:231 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2662024-12-20T21:10:21.588ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11526153984455044204 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2672024-12-20T21:10:21.588ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16293036310606771885 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2682024-12-20T21:10:21.810ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
2692024-12-20T21:10:21.858ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }
2702024-12-20T21:10:21.865ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2712024-12-20T21:10:21.865ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2722024-12-20T21:10:21.865ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2732024-12-20T21:10:21.865ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2742024-12-20T21:10:21.865ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-12-20T21:10:21.865ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762024-12-20T21:10:21.865ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2772024-12-20T21:10:21.898ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2782024-12-20T21:10:21.905ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone file = sled-storage/src/dataset.rs:302
2792024-12-20T21:10:22.034ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6cbb0b58-4d44-45b0-895e-d80165779045 file = sled-storage/src/dataset.rs:388
2802024-12-20T21:10:22.041ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2812024-12-20T21:10:22.041ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2822024-12-20T21:10:22.041ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2832024-12-20T21:10:22.041ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842024-12-20T21:10:22.041ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2852024-12-20T21:10:22.050ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2862024-12-20T21:10:22.050ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool)
2872024-12-20T21:10:22.141ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }
2882024-12-20T21:10:22.148ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2892024-12-20T21:10:22.148ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2902024-12-20T21:10:22.148ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2912024-12-20T21:10:22.148ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2922024-12-20T21:10:22.148ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-20T21:10:22.148ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-12-20T21:10:22.148ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2952024-12-20T21:10:22.182ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2962024-12-20T21:10:22.189ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone file = sled-storage/src/dataset.rs:302
2972024-12-20T21:10:22.320ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8 file = sled-storage/src/dataset.rs:388
2982024-12-20T21:10:22.327ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2992024-12-20T21:10:22.327ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3002024-12-20T21:10:22.327ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3012024-12-20T21:10:22.327ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3022024-12-20T21:10:22.327ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032024-12-20T21:10:22.337ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3042024-12-20T21:10:22.337ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 70bee423-c23a-4941-9c18-69f4feca1839 (zpool)
3052024-12-20T21:10:22.430ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }
3062024-12-20T21:10:22.438ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3072024-12-20T21:10:22.438ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3082024-12-20T21:10:22.438ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3092024-12-20T21:10:22.438ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3102024-12-20T21:10:22.438ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-12-20T21:10:22.438ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-12-20T21:10:22.438ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3132024-12-20T21:10:22.474ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-12-20T21:10:22.482ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone file = sled-storage/src/dataset.rs:302
3152024-12-20T21:10:22.589ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9ab49b39-4891-4f63-9152-18cfc9c75d04) file = sled-agent/src/probe_manager.rs:231 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
3162024-12-20T21:10:22.624ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_70bee423-c23a-4941-9c18-69f4feca1839 file = sled-storage/src/dataset.rs:388
3172024-12-20T21:10:22.632ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3182024-12-20T21:10:22.632ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3192024-12-20T21:10:22.632ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3202024-12-20T21:10:22.632ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3212024-12-20T21:10:22.632ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222024-12-20T21:10:22.642ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3232024-12-20T21:10:22.642ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d53f565a-e812-4053-98b4-59c34d29e75c (zpool)
3242024-12-20T21:10:22.734ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }
3252024-12-20T21:10:22.743ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3262024-12-20T21:10:22.743ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3272024-12-20T21:10:22.743ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3282024-12-20T21:10:22.743ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3292024-12-20T21:10:22.743ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-12-20T21:10:22.743ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-12-20T21:10:22.743ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3322024-12-20T21:10:22.780ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332024-12-20T21:10:22.787ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d53f565a-e812-4053-98b4-59c34d29e75c/crypt/zone file = sled-storage/src/dataset.rs:302
3342024-12-20T21:10:22.923ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d53f565a-e812-4053-98b4-59c34d29e75c file = sled-storage/src/dataset.rs:388
3352024-12-20T21:10:22.931ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3362024-12-20T21:10:22.931ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3372024-12-20T21:10:22.931ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3382024-12-20T21:10:22.931ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3392024-12-20T21:10:22.931ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402024-12-20T21:10:22.940ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3412024-12-20T21:10:22.941ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool)
3422024-12-20T21:10:23.039ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }
3432024-12-20T21:10:23.047ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3442024-12-20T21:10:23.047ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3452024-12-20T21:10:23.047ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3462024-12-20T21:10:23.047ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3472024-12-20T21:10:23.047ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-12-20T21:10:23.047ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-12-20T21:10:23.047ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3502024-12-20T21:10:23.084ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512024-12-20T21:10:23.092ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/zone file = sled-storage/src/dataset.rs:302
3522024-12-20T21:10:23.231ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75 file = sled-storage/src/dataset.rs:388
3532024-12-20T21:10:23.239ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3542024-12-20T21:10:23.239ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3552024-12-20T21:10:23.239ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3562024-12-20T21:10:23.239ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3572024-12-20T21:10:23.239ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3582024-12-20T21:10:23.249ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3592024-12-20T21:10:23.249ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool)
3602024-12-20T21:10:23.341ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }
3612024-12-20T21:10:23.349ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3622024-12-20T21:10:23.349ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3632024-12-20T21:10:23.349ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3642024-12-20T21:10:23.349ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3652024-12-20T21:10:23.349ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-20T21:10:23.349ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-12-20T21:10:23.349ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3682024-12-20T21:10:23.384ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-12-20T21:10:23.392ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4d0b1b25-4a74-46a6-945f-18014df947c1/crypt/zone file = sled-storage/src/dataset.rs:302
3702024-12-20T21:10:23.532ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4d0b1b25-4a74-46a6-945f-18014df947c1 file = sled-storage/src/dataset.rs:388
3712024-12-20T21:10:23.540ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3722024-12-20T21:10:23.540ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3732024-12-20T21:10:23.540ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3742024-12-20T21:10:23.540ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3752024-12-20T21:10:23.540ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762024-12-20T21:10:23.550ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3772024-12-20T21:10:23.550ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool)
3782024-12-20T21:10:23.643ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }
3792024-12-20T21:10:23.650ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3802024-12-20T21:10:23.651ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3812024-12-20T21:10:23.651ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3822024-12-20T21:10:23.651ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3832024-12-20T21:10:23.651ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-20T21:10:23.651ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-12-20T21:10:23.651ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3862024-12-20T21:10:23.654ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9ab49b39-4891-4f63-9152-18cfc9c75d04) file = sled-agent/src/probe_manager.rs:231 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
3872024-12-20T21:10:23.689ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3882024-12-20T21:10:23.697ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/zone file = sled-storage/src/dataset.rs:302
3892024-12-20T21:10:23.844ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2 file = sled-storage/src/dataset.rs:388
3902024-12-20T21:10:23.851ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3912024-12-20T21:10:23.851ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3922024-12-20T21:10:23.851ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3932024-12-20T21:10:23.851ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3942024-12-20T21:10:23.851ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3952024-12-20T21:10:23.861ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3962024-12-20T21:10:23.861ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool)
3972024-12-20T21:10:23.955ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }
3982024-12-20T21:10:23.963ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3992024-12-20T21:10:23.963ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4002024-12-20T21:10:23.963ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4012024-12-20T21:10:23.963ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4022024-12-20T21:10:23.963ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-12-20T21:10:23.963ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-12-20T21:10:23.963ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4052024-12-20T21:10:23.998ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4062024-12-20T21:10:24.006ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crypt/zone file = sled-storage/src/dataset.rs:302
4072024-12-20T21:10:24.143ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94 file = sled-storage/src/dataset.rs:388
4082024-12-20T21:10:24.150ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4092024-12-20T21:10:24.150ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4102024-12-20T21:10:24.150ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4112024-12-20T21:10:24.150ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4122024-12-20T21:10:24.150ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4132024-12-20T21:10:24.160ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4142024-12-20T21:10:24.160ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool)
4152024-12-20T21:10:24.256ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }
4162024-12-20T21:10:24.264ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4172024-12-20T21:10:24.264ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4182024-12-20T21:10:24.264ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4192024-12-20T21:10:24.264ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4202024-12-20T21:10:24.264ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-20T21:10:24.264ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-12-20T21:10:24.264ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4232024-12-20T21:10:24.301ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4242024-12-20T21:10:24.308ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone file = sled-storage/src/dataset.rs:302
4252024-12-20T21:10:24.450ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e file = sled-storage/src/dataset.rs:388
4262024-12-20T21:10:24.458ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4272024-12-20T21:10:24.458ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4282024-12-20T21:10:24.458ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4292024-12-20T21:10:24.458ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5b1517f-af84-4f35-9630-726554609cf4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70a61009-8fd6-48ae-91bd-7281148cd83a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4302024-12-20T21:10:24.458ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4312024-12-20T21:10:24.458ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4322024-12-20T21:10:24.459ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332024-12-20T21:10:24.459ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
4342024-12-20T21:10:24.459ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4352024-12-20T21:10:24.459ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
4362024-12-20T21:10:24.459ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
4372024-12-20T21:10:24.459ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
4382024-12-20T21:10:24.459ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
4392024-12-20T21:10:24.459ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
4402024-12-20T21:10:24.459ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4412024-12-20T21:10:24.459ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
4422024-12-20T21:10:24.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3433745 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47724 req_id = b36b5bc3-973c-4633-b0c9-406c69b156a8 response_code = 200 uri = /omicron-physical-disks
4432024-12-20T21:10:24.491ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {03d73710-c567-49a6-b9ed-a778d2711b48 (dataset): DatasetConfig { id: 03d73710-c567-49a6-b9ed-a778d2711b48 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0634b9e5-bc87-4ff4-9135-016c771219e0 (dataset): DatasetConfig { id: 0634b9e5-bc87-4ff4-9135-016c771219e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09296773-72f6-47c5-82e9-5f1c5f16b4ef (dataset): DatasetConfig { id: 09296773-72f6-47c5-82e9-5f1c5f16b4ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 19168f4b-7920-44bb-80c7-230ccf7440a1 (dataset): DatasetConfig { id: 19168f4b-7920-44bb-80c7-230ccf7440a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19b8c442-dadd-4808-babc-a508aa4861a1 (dataset): DatasetConfig { id: 19b8c442-dadd-4808-babc-a508aa4861a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e5cfe4e-01cd-45d9-bbb8-3b522d0712fc (dataset): DatasetConfig { id: 1e5cfe4e-01cd-45d9-bbb8-3b522d0712fc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23e478ac-15fb-4e52-8076-ee17745d4c50 (dataset): DatasetConfig { id: 23e478ac-15fb-4e52-8076-ee17745d4c50 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24aa2135-ce7d-4c2f-867d-6fb1958afc4c (dataset): DatasetConfig { id: 24aa2135-ce7d-4c2f-867d-6fb1958afc4c (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e60d921-b6cf-4eb3-91b7-76b749b6968a (dataset): DatasetConfig { id: 2e60d921-b6cf-4eb3-91b7-76b749b6968a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32484f7e-ac83-4ac7-90e8-1dbbcf3781b7 (dataset): DatasetConfig { id: 32484f7e-ac83-4ac7-90e8-1dbbcf3781b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3410a4ea-13d9-4c3a-9bf8-47eef584c1da (dataset): DatasetConfig { id: 3410a4ea-13d9-4c3a-9bf8-47eef584c1da (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 378a3a1d-f20f-4f36-9e0e-0237a5a1d7bc (dataset): DatasetConfig { id: 378a3a1d-f20f-4f36-9e0e-0237a5a1d7bc (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42913ddf-57c6-436f-8456-2416cd124a84 (dataset): DatasetConfig { id: 42913ddf-57c6-436f-8456-2416cd124a84 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 430b8981-d4e3-45b0-bfa8-1b0c363c970c (dataset): DatasetConfig { id: 430b8981-d4e3-45b0-bfa8-1b0c363c970c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46698d0f-a01a-4b40-9b01-6b1e681592f5 (dataset): DatasetConfig { id: 46698d0f-a01a-4b40-9b01-6b1e681592f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4794fbea-f379-4ab0-9092-64453c073995 (dataset): DatasetConfig { id: 4794fbea-f379-4ab0-9092-64453c073995 (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4db687fe-9735-45c8-bd8d-9a660739cf6d (dataset): DatasetConfig { id: 4db687fe-9735-45c8-bd8d-9a660739cf6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51894066-d5c1-40cd-a41f-982236447df4 (dataset): DatasetConfig { id: 51894066-d5c1-40cd-a41f-982236447df4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 52062dde-f053-4f93-b0e6-677067505637 (dataset): DatasetConfig { id: 52062dde-f053-4f93-b0e6-677067505637 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54ede710-d421-4e7c-b119-e2552bc60649 (dataset): DatasetConfig { id: 54ede710-d421-4e7c-b119-e2552bc60649 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 55f03948-c5fe-4a2f-bee2-3a51cdf64e18 (dataset): DatasetConfig { id: 55f03948-c5fe-4a2f-bee2-3a51cdf64e18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 57e11abf-ba09-4320-8c49-09a10ae69ccc (dataset): DatasetConfig { id: 57e11abf-ba09-4320-8c49-09a10ae69ccc (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ab93a0b-62e0-4150-b77b-91534aaa6173 (dataset): DatasetConfig { id: 5ab93a0b-62e0-4150-b77b-91534aaa6173 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e92aa57-757d-45b9-87ee-36e689822373 (dataset): DatasetConfig { id: 5e92aa57-757d-45b9-87ee-36e689822373 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 683f8f70-e601-4e3f-aa2d-9de83beaf590 (dataset): DatasetConfig { id: 683f8f70-e601-4e3f-aa2d-9de83beaf590 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 688e8bef-e1fc-4f9f-87ea-01d70dcc98ab (dataset): DatasetConfig { id: 688e8bef-e1fc-4f9f-87ea-01d70dcc98ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e6d4735-2d2a-4dec-a262-f23e014cacd8 (dataset): DatasetConfig { id: 6e6d4735-2d2a-4dec-a262-f23e014cacd8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e979b32-42eb-4a4d-a424-7e606f542b65 (dataset): DatasetConfig { id: 6e979b32-42eb-4a4d-a424-7e606f542b65 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 724ef5dc-c9ba-46fa-aeb0-012d152bae10 (dataset): DatasetConfig { id: 724ef5dc-c9ba-46fa-aeb0-012d152bae10 (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 731b7bd7-ff5b-4f72-86c6-623b8d060137 (dataset): DatasetConfig { id: 731b7bd7-ff5b-4f72-86c6-623b8d060137 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75c7e692-36e6-4b2e-9f4e-3fa7477379c7 (dataset): DatasetConfig { id: 75c7e692-36e6-4b2e-9f4e-3fa7477379c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 784e630b-8a5d-49e2-905d-c028d9b024f6 (dataset): DatasetConfig { id: 784e630b-8a5d-49e2-905d-c028d9b024f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a4b17e4-55a1-417b-accc-4ce5dffb7429 (dataset): DatasetConfig { id: 7a4b17e4-55a1-417b-accc-4ce5dffb7429 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c7a537f-4fe0-46f1-b935-dfbb220261eb (dataset): DatasetConfig { id: 7c7a537f-4fe0-46f1-b935-dfbb220261eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7eeafb9a-82ae-431a-b41c-3b09740dfe1b (dataset): DatasetConfig { id: 7eeafb9a-82ae-431a-b41c-3b09740dfe1b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 833c41c4-c6fa-4c6d-a68a-2d00be004638 (dataset): DatasetConfig { id: 833c41c4-c6fa-4c6d-a68a-2d00be004638 (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 877748c5-46c7-463f-8a48-6e06dff70674 (dataset): DatasetConfig { id: 877748c5-46c7-463f-8a48-6e06dff70674 (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 890b7f1e-d220-42af-b505-e5df7402c088 (dataset): DatasetConfig { id: 890b7f1e-d220-42af-b505-e5df7402c088 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e8142ae-cb22-4ede-9932-e0595d3d5558 (dataset): DatasetConfig { id: 9e8142ae-cb22-4ede-9932-e0595d3d5558 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a329d134-823c-4aeb-8d39-aa6f6125138d (dataset): DatasetConfig { id: a329d134-823c-4aeb-8d39-aa6f6125138d (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aae0a3fd-2ecf-4731-8632-0b3b3941a870 (dataset): DatasetConfig { id: aae0a3fd-2ecf-4731-8632-0b3b3941a870 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aeb779c7-57fe-4ea0-9036-e8f4bfbbd580 (dataset): DatasetConfig { id: aeb779c7-57fe-4ea0-9036-e8f4bfbbd580 (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1453203-9ec3-4ba1-a0a1-8384f95c6d72 (dataset): DatasetConfig { id: b1453203-9ec3-4ba1-a0a1-8384f95c6d72 (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b794e69b-d193-4498-bcb5-6df0cef00649 (dataset): DatasetConfig { id: b794e69b-d193-4498-bcb5-6df0cef00649 (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb153153-967e-40fa-bf4d-a842f6767dfd (dataset): DatasetConfig { id: bb153153-967e-40fa-bf4d-a842f6767dfd (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc10045a-0378-4810-be6b-9d3172a1aa2f (dataset): DatasetConfig { id: bc10045a-0378-4810-be6b-9d3172a1aa2f (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c0f78253-8ba9-4957-b286-9f9eac5e3e6f (dataset): DatasetConfig { id: c0f78253-8ba9-4957-b286-9f9eac5e3e6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2c523ae-ca8a-4bcd-a4f2-0fb5cba1f388 (dataset): DatasetConfig { id: c2c523ae-ca8a-4bcd-a4f2-0fb5cba1f388 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c3a71157-8862-4e31-b00d-7bee0d5b67f6 (dataset): DatasetConfig { id: c3a71157-8862-4e31-b00d-7bee0d5b67f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c732b942-2ea5-4e40-a2ef-8fdc8a93c4fd (dataset): DatasetConfig { id: c732b942-2ea5-4e40-a2ef-8fdc8a93c4fd (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8d87211-c253-4490-90a8-f7d16c98b09a (dataset): DatasetConfig { id: c8d87211-c253-4490-90a8-f7d16c98b09a (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cf3968e8-1381-444b-be60-0da82e57745f (dataset): DatasetConfig { id: cf3968e8-1381-444b-be60-0da82e57745f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d06e56d9-23ef-4b22-bcfc-9e47449db3ca (dataset): DatasetConfig { id: d06e56d9-23ef-4b22-bcfc-9e47449db3ca (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d37c68c9-bf29-4e09-a6ec-55f475a38d48 (dataset): DatasetConfig { id: d37c68c9-bf29-4e09-a6ec-55f475a38d48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, daa81669-7e52-475c-aa33-41003c932525 (dataset): DatasetConfig { id: daa81669-7e52-475c-aa33-41003c932525 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2b97484-510c-43ed-9a04-8a002b9b624f (dataset): DatasetConfig { id: e2b97484-510c-43ed-9a04-8a002b9b624f (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6943905-4c11-4ec0-bf27-154b3bb67d6b (dataset): DatasetConfig { id: e6943905-4c11-4ec0-bf27-154b3bb67d6b (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea3a0ff0-cdb2-45cb-b4a8-3641d1316002 (dataset): DatasetConfig { id: ea3a0ff0-cdb2-45cb-b4a8-3641d1316002 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb1eccf6-ecc4-4743-94c5-fa745ca52574 (dataset): DatasetConfig { id: eb1eccf6-ecc4-4743-94c5-fa745ca52574 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edeb1600-e717-4bfc-b2c3-038b6164774a (dataset): DatasetConfig { id: edeb1600-e717-4bfc-b2c3-038b6164774a (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f37c70e8-bb61-4071-890e-fdd59b7c1c31 (dataset): DatasetConfig { id: f37c70e8-bb61-4071-890e-fdd59b7c1c31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3ff121e-ddaf-400c-98dd-807b0eb7e732 (dataset): DatasetConfig { id: f3ff121e-ddaf-400c-98dd-807b0eb7e732 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f995bb76-98b0-4a99-86fa-60bf060077a3 (dataset): DatasetConfig { id: f995bb76-98b0-4a99-86fa-60bf060077a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa51227b-22ae-4f32-8f00-d239d29866a3 (dataset): DatasetConfig { id: fa51227b-22ae-4f32-8f00-d239d29866a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fb92d96c-a70e-4ab6-ac99-a4292e572e69 (dataset): DatasetConfig { id: fb92d96c-a70e-4ab6-ac99-a4292e572e69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fcdda09c-7f3f-4212-a9d7-698894b9c41c (dataset): DatasetConfig { id: fcdda09c-7f3f-4212-a9d7-698894b9c41c (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4442024-12-20T21:10:24.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39081
4452024-12-20T21:10:24.492ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
4462024-12-20T21:10:24.492ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {03d73710-c567-49a6-b9ed-a778d2711b48 (dataset): DatasetConfig { id: 03d73710-c567-49a6-b9ed-a778d2711b48 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0634b9e5-bc87-4ff4-9135-016c771219e0 (dataset): DatasetConfig { id: 0634b9e5-bc87-4ff4-9135-016c771219e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09296773-72f6-47c5-82e9-5f1c5f16b4ef (dataset): DatasetConfig { id: 09296773-72f6-47c5-82e9-5f1c5f16b4ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 19168f4b-7920-44bb-80c7-230ccf7440a1 (dataset): DatasetConfig { id: 19168f4b-7920-44bb-80c7-230ccf7440a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19b8c442-dadd-4808-babc-a508aa4861a1 (dataset): DatasetConfig { id: 19b8c442-dadd-4808-babc-a508aa4861a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e5cfe4e-01cd-45d9-bbb8-3b522d0712fc (dataset): DatasetConfig { id: 1e5cfe4e-01cd-45d9-bbb8-3b522d0712fc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23e478ac-15fb-4e52-8076-ee17745d4c50 (dataset): DatasetConfig { id: 23e478ac-15fb-4e52-8076-ee17745d4c50 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24aa2135-ce7d-4c2f-867d-6fb1958afc4c (dataset): DatasetConfig { id: 24aa2135-ce7d-4c2f-867d-6fb1958afc4c (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e60d921-b6cf-4eb3-91b7-76b749b6968a (dataset): DatasetConfig { id: 2e60d921-b6cf-4eb3-91b7-76b749b6968a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32484f7e-ac83-4ac7-90e8-1dbbcf3781b7 (dataset): DatasetConfig { id: 32484f7e-ac83-4ac7-90e8-1dbbcf3781b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3410a4ea-13d9-4c3a-9bf8-47eef584c1da (dataset): DatasetConfig { id: 3410a4ea-13d9-4c3a-9bf8-47eef584c1da (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 378a3a1d-f20f-4f36-9e0e-0237a5a1d7bc (dataset): DatasetConfig { id: 378a3a1d-f20f-4f36-9e0e-0237a5a1d7bc (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42913ddf-57c6-436f-8456-2416cd124a84 (dataset): DatasetConfig { id: 42913ddf-57c6-436f-8456-2416cd124a84 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 430b8981-d4e3-45b0-bfa8-1b0c363c970c (dataset): DatasetConfig { id: 430b8981-d4e3-45b0-bfa8-1b0c363c970c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46698d0f-a01a-4b40-9b01-6b1e681592f5 (dataset): DatasetConfig { id: 46698d0f-a01a-4b40-9b01-6b1e681592f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4794fbea-f379-4ab0-9092-64453c073995 (dataset): DatasetConfig { id: 4794fbea-f379-4ab0-9092-64453c073995 (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4db687fe-9735-45c8-bd8d-9a660739cf6d (dataset): DatasetConfig { id: 4db687fe-9735-45c8-bd8d-9a660739cf6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51894066-d5c1-40cd-a41f-982236447df4 (dataset): DatasetConfig { id: 51894066-d5c1-40cd-a41f-982236447df4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 52062dde-f053-4f93-b0e6-677067505637 (dataset): DatasetConfig { id: 52062dde-f053-4f93-b0e6-677067505637 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54ede710-d421-4e7c-b119-e2552bc60649 (dataset): DatasetConfig { id: 54ede710-d421-4e7c-b119-e2552bc60649 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 55f03948-c5fe-4a2f-bee2-3a51cdf64e18 (dataset): DatasetConfig { id: 55f03948-c5fe-4a2f-bee2-3a51cdf64e18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 57e11abf-ba09-4320-8c49-09a10ae69ccc (dataset): DatasetConfig { id: 57e11abf-ba09-4320-8c49-09a10ae69ccc (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ab93a0b-62e0-4150-b77b-91534aaa6173 (dataset): DatasetConfig { id: 5ab93a0b-62e0-4150-b77b-91534aaa6173 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e92aa57-757d-45b9-87ee-36e689822373 (dataset): DatasetConfig { id: 5e92aa57-757d-45b9-87ee-36e689822373 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 683f8f70-e601-4e3f-aa2d-9de83beaf590 (dataset): DatasetConfig { id: 683f8f70-e601-4e3f-aa2d-9de83beaf590 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 688e8bef-e1fc-4f9f-87ea-01d70dcc98ab (dataset): DatasetConfig { id: 688e8bef-e1fc-4f9f-87ea-01d70dcc98ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e6d4735-2d2a-4dec-a262-f23e014cacd8 (dataset): DatasetConfig { id: 6e6d4735-2d2a-4dec-a262-f23e014cacd8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e979b32-42eb-4a4d-a424-7e606f542b65 (dataset): DatasetConfig { id: 6e979b32-42eb-4a4d-a424-7e606f542b65 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 724ef5dc-c9ba-46fa-aeb0-012d152bae10 (dataset): DatasetConfig { id: 724ef5dc-c9ba-46fa-aeb0-012d152bae10 (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 731b7bd7-ff5b-4f72-86c6-623b8d060137 (dataset): DatasetConfig { id: 731b7bd7-ff5b-4f72-86c6-623b8d060137 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75c7e692-36e6-4b2e-9f4e-3fa7477379c7 (dataset): DatasetConfig { id: 75c7e692-36e6-4b2e-9f4e-3fa7477379c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 784e630b-8a5d-49e2-905d-c028d9b024f6 (dataset): DatasetConfig { id: 784e630b-8a5d-49e2-905d-c028d9b024f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a4b17e4-55a1-417b-accc-4ce5dffb7429 (dataset): DatasetConfig { id: 7a4b17e4-55a1-417b-accc-4ce5dffb7429 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c7a537f-4fe0-46f1-b935-dfbb220261eb (dataset): DatasetConfig { id: 7c7a537f-4fe0-46f1-b935-dfbb220261eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7eeafb9a-82ae-431a-b41c-3b09740dfe1b (dataset): DatasetConfig { id: 7eeafb9a-82ae-431a-b41c-3b09740dfe1b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 833c41c4-c6fa-4c6d-a68a-2d00be004638 (dataset): DatasetConfig { id: 833c41c4-c6fa-4c6d-a68a-2d00be004638 (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 877748c5-46c7-463f-8a48-6e06dff70674 (dataset): DatasetConfig { id: 877748c5-46c7-463f-8a48-6e06dff70674 (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 890b7f1e-d220-42af-b505-e5df7402c088 (dataset): DatasetConfig { id: 890b7f1e-d220-42af-b505-e5df7402c088 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e8142ae-cb22-4ede-9932-e0595d3d5558 (dataset): DatasetConfig { id: 9e8142ae-cb22-4ede-9932-e0595d3d5558 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a329d134-823c-4aeb-8d39-aa6f6125138d (dataset): DatasetConfig { id: a329d134-823c-4aeb-8d39-aa6f6125138d (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aae0a3fd-2ecf-4731-8632-0b3b3941a870 (dataset): DatasetConfig { id: aae0a3fd-2ecf-4731-8632-0b3b3941a870 (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aeb779c7-57fe-4ea0-9036-e8f4bfbbd580 (dataset): DatasetConfig { id: aeb779c7-57fe-4ea0-9036-e8f4bfbbd580 (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1453203-9ec3-4ba1-a0a1-8384f95c6d72 (dataset): DatasetConfig { id: b1453203-9ec3-4ba1-a0a1-8384f95c6d72 (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b794e69b-d193-4498-bcb5-6df0cef00649 (dataset): DatasetConfig { id: b794e69b-d193-4498-bcb5-6df0cef00649 (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb153153-967e-40fa-bf4d-a842f6767dfd (dataset): DatasetConfig { id: bb153153-967e-40fa-bf4d-a842f6767dfd (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc10045a-0378-4810-be6b-9d3172a1aa2f (dataset): DatasetConfig { id: bc10045a-0378-4810-be6b-9d3172a1aa2f (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c0f78253-8ba9-4957-b286-9f9eac5e3e6f (dataset): DatasetConfig { id: c0f78253-8ba9-4957-b286-9f9eac5e3e6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2c523ae-ca8a-4bcd-a4f2-0fb5cba1f388 (dataset): DatasetConfig { id: c2c523ae-ca8a-4bcd-a4f2-0fb5cba1f388 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c3a71157-8862-4e31-b00d-7bee0d5b67f6 (dataset): DatasetConfig { id: c3a71157-8862-4e31-b00d-7bee0d5b67f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c732b942-2ea5-4e40-a2ef-8fdc8a93c4fd (dataset): DatasetConfig { id: c732b942-2ea5-4e40-a2ef-8fdc8a93c4fd (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8d87211-c253-4490-90a8-f7d16c98b09a (dataset): DatasetConfig { id: c8d87211-c253-4490-90a8-f7d16c98b09a (dataset), name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cf3968e8-1381-444b-be60-0da82e57745f (dataset): DatasetConfig { id: cf3968e8-1381-444b-be60-0da82e57745f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d06e56d9-23ef-4b22-bcfc-9e47449db3ca (dataset): DatasetConfig { id: d06e56d9-23ef-4b22-bcfc-9e47449db3ca (dataset), name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d37c68c9-bf29-4e09-a6ec-55f475a38d48 (dataset): DatasetConfig { id: d37c68c9-bf29-4e09-a6ec-55f475a38d48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, daa81669-7e52-475c-aa33-41003c932525 (dataset): DatasetConfig { id: daa81669-7e52-475c-aa33-41003c932525 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2b97484-510c-43ed-9a04-8a002b9b624f (dataset): DatasetConfig { id: e2b97484-510c-43ed-9a04-8a002b9b624f (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6943905-4c11-4ec0-bf27-154b3bb67d6b (dataset): DatasetConfig { id: e6943905-4c11-4ec0-bf27-154b3bb67d6b (dataset), name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea3a0ff0-cdb2-45cb-b4a8-3641d1316002 (dataset): DatasetConfig { id: ea3a0ff0-cdb2-45cb-b4a8-3641d1316002 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb1eccf6-ecc4-4743-94c5-fa745ca52574 (dataset): DatasetConfig { id: eb1eccf6-ecc4-4743-94c5-fa745ca52574 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edeb1600-e717-4bfc-b2c3-038b6164774a (dataset): DatasetConfig { id: edeb1600-e717-4bfc-b2c3-038b6164774a (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f37c70e8-bb61-4071-890e-fdd59b7c1c31 (dataset): DatasetConfig { id: f37c70e8-bb61-4071-890e-fdd59b7c1c31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3ff121e-ddaf-400c-98dd-807b0eb7e732 (dataset): DatasetConfig { id: f3ff121e-ddaf-400c-98dd-807b0eb7e732 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f995bb76-98b0-4a99-86fa-60bf060077a3 (dataset): DatasetConfig { id: f995bb76-98b0-4a99-86fa-60bf060077a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa51227b-22ae-4f32-8f00-d239d29866a3 (dataset): DatasetConfig { id: fa51227b-22ae-4f32-8f00-d239d29866a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fb92d96c-a70e-4ab6-ac99-a4292e572e69 (dataset): DatasetConfig { id: fb92d96c-a70e-4ab6-ac99-a4292e572e69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fcdda09c-7f3f-4212-a9d7-698894b9c41c (dataset): DatasetConfig { id: fcdda09c-7f3f-4212-a9d7-698894b9c41c (dataset), name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4472024-12-20T21:10:24.492ZINFOSledAgent (StorageManager): No ledger in /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-20T21:10:24.492ZINFOSledAgent (StorageManager): No ledger in /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4492024-12-20T21:10:24.492ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4502024-12-20T21:10:24.508ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4512024-12-20T21:10:24.508ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4522024-12-20T21:10:24.508ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone/oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4"), full_name: "oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone/oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4" } file = sled-storage/src/manager.rs:1431
4532024-12-20T21:10:24.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542024-12-20T21:10:24.569ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4552024-12-20T21:10:24.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d53f565a-e812-4053-98b4-59c34d29e75c/crypt/zone/oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4"), full_name: "oxp_d53f565a-e812-4053-98b4-59c34d29e75c/crypt/zone/oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4" } file = sled-storage/src/manager.rs:1431
4562024-12-20T21:10:24.629ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572024-12-20T21:10:24.629ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4582024-12-20T21:10:24.629ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/70bee423-c23a-4941-9c18-69f4feca1839/crypt/debug"), full_name: "oxp_70bee423-c23a-4941-9c18-69f4feca1839/crypt/debug" } file = sled-storage/src/manager.rs:1431
4592024-12-20T21:10:24.657ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9ab49b39-4891-4f63-9152-18cfc9c75d04) file = sled-agent/src/probe_manager.rs:231 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
4602024-12-20T21:10:24.658ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612024-12-20T21:10:24.658ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4622024-12-20T21:10:24.658ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone/oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931"), full_name: "oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone/oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931" } file = sled-storage/src/manager.rs:1431
4632024-12-20T21:10:24.717ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642024-12-20T21:10:24.717ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652024-12-20T21:10:24.717ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4662024-12-20T21:10:24.765ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672024-12-20T21:10:24.765ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4682024-12-20T21:10:24.765ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3aaf6321-1f78-413a-aeef-fc748a8d6f94/crypt/zone/oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e"), full_name: "oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crypt/zone/oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e" } file = sled-storage/src/manager.rs:1431
4692024-12-20T21:10:24.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702024-12-20T21:10:24.825ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4712024-12-20T21:10:24.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone"), full_name: "oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone" } file = sled-storage/src/manager.rs:1431
4722024-12-20T21:10:24.854ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732024-12-20T21:10:24.854ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4742024-12-20T21:10:24.854ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/zone"), full_name: "oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/zone" } file = sled-storage/src/manager.rs:1431
4752024-12-20T21:10:24.874ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 16.061204958s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
4762024-12-20T21:10:24.883ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772024-12-20T21:10:24.883ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782024-12-20T21:10:24.883ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone/oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone/oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f" } file = sled-storage/src/manager.rs:1431
4792024-12-20T21:10:24.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802024-12-20T21:10:24.941ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812024-12-20T21:10:24.941ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4822024-12-20T21:10:24.991ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832024-12-20T21:10:24.991ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4842024-12-20T21:10:24.991ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d0b1b25-4a74-46a6-945f-18014df947c1/crypt/debug"), full_name: "oxp_4d0b1b25-4a74-46a6-945f-18014df947c1/crypt/debug" } file = sled-storage/src/manager.rs:1431
4852024-12-20T21:10:25.019ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862024-12-20T21:10:25.019ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872024-12-20T21:10:25.019ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone/oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b"), full_name: "oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone/oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b" } file = sled-storage/src/manager.rs:1431
4882024-12-20T21:10:25.078ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892024-12-20T21:10:25.078ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902024-12-20T21:10:25.078ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4912024-12-20T21:10:25.127ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922024-12-20T21:10:25.128ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4932024-12-20T21:10:25.128ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3aaf6321-1f78-413a-aeef-fc748a8d6f94/crypt/zone"), full_name: "oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crypt/zone" } file = sled-storage/src/manager.rs:1431
4942024-12-20T21:10:25.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952024-12-20T21:10:25.156ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4962024-12-20T21:10:25.156ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone" } file = sled-storage/src/manager.rs:1431
4972024-12-20T21:10:25.185ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982024-12-20T21:10:25.185ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992024-12-20T21:10:25.185ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75/crucible" } file = sled-storage/src/manager.rs:1431
5002024-12-20T21:10:25.230ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012024-12-20T21:10:25.230ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5022024-12-20T21:10:25.230ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2/crucible" } file = sled-storage/src/manager.rs:1431
5032024-12-20T21:10:25.277ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042024-12-20T21:10:25.277ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5052024-12-20T21:10:25.277ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6cbb0b58-4d44-45b0-895e-d80165779045/crypt/debug"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/debug" } file = sled-storage/src/manager.rs:1431
5062024-12-20T21:10:25.305ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072024-12-20T21:10:25.305ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5082024-12-20T21:10:25.305ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d0b1b25-4a74-46a6-945f-18014df947c1/crypt/zone"), full_name: "oxp_4d0b1b25-4a74-46a6-945f-18014df947c1/crypt/zone" } file = sled-storage/src/manager.rs:1431
5092024-12-20T21:10:25.333ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102024-12-20T21:10:25.333ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5112024-12-20T21:10:25.333ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/debug"), full_name: "oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/debug" } file = sled-storage/src/manager.rs:1431
5122024-12-20T21:10:25.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132024-12-20T21:10:25.361ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5142024-12-20T21:10:25.361ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/debug"), full_name: "oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/debug" } file = sled-storage/src/manager.rs:1431
5152024-12-20T21:10:25.390ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162024-12-20T21:10:25.390ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5172024-12-20T21:10:25.390ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone/oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone/oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0" } file = sled-storage/src/manager.rs:1431
5182024-12-20T21:10:25.449ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192024-12-20T21:10:25.449ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202024-12-20T21:10:25.449ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d0b1b25-4a74-46a6-945f-18014df947c1/crypt/zone/oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369"), full_name: "oxp_4d0b1b25-4a74-46a6-945f-18014df947c1/crypt/zone/oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369" } file = sled-storage/src/manager.rs:1431
5212024-12-20T21:10:25.506ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222024-12-20T21:10:25.506ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5232024-12-20T21:10:25.506ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5242024-12-20T21:10:25.555ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252024-12-20T21:10:25.555ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262024-12-20T21:10:25.555ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5272024-12-20T21:10:25.604ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282024-12-20T21:10:25.604ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5292024-12-20T21:10:25.604ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_70bee423-c23a-4941-9c18-69f4feca1839/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5302024-12-20T21:10:25.651ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312024-12-20T21:10:25.651ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5322024-12-20T21:10:25.651ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/zone"), full_name: "oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/zone" } file = sled-storage/src/manager.rs:1431
5332024-12-20T21:10:25.659ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9ab49b39-4891-4f63-9152-18cfc9c75d04) file = sled-agent/src/probe_manager.rs:231 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
5342024-12-20T21:10:25.680ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352024-12-20T21:10:25.680ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362024-12-20T21:10:25.680ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone/oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone/oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35" } file = sled-storage/src/manager.rs:1431
5372024-12-20T21:10:25.737ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382024-12-20T21:10:25.737ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5392024-12-20T21:10:25.737ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone"), full_name: "oxp_70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone" } file = sled-storage/src/manager.rs:1431
5402024-12-20T21:10:25.768ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412024-12-20T21:10:25.768ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422024-12-20T21:10:25.768ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crucible" } file = sled-storage/src/manager.rs:1431
5432024-12-20T21:10:25.816ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442024-12-20T21:10:25.816ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452024-12-20T21:10:25.816ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crucible" } file = sled-storage/src/manager.rs:1431
5462024-12-20T21:10:25.865ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472024-12-20T21:10:25.865ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5482024-12-20T21:10:25.865ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone/oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656"), full_name: "oxp_70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone/oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656" } file = sled-storage/src/manager.rs:1431
5492024-12-20T21:10:25.924ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502024-12-20T21:10:25.924ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512024-12-20T21:10:25.924ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone/oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71"), full_name: "oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone/oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71" } file = sled-storage/src/manager.rs:1431
5522024-12-20T21:10:25.982ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532024-12-20T21:10:25.982ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542024-12-20T21:10:25.982ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_70bee423-c23a-4941-9c18-69f4feca1839/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5552024-12-20T21:10:26.033ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562024-12-20T21:10:26.033ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5572024-12-20T21:10:26.033ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone/oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone/oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4" } file = sled-storage/src/manager.rs:1431
5582024-12-20T21:10:26.092ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592024-12-20T21:10:26.092ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602024-12-20T21:10:26.092ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/zone/oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f"), full_name: "oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/zone/oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f" } file = sled-storage/src/manager.rs:1431
5612024-12-20T21:10:26.149ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622024-12-20T21:10:26.149ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5632024-12-20T21:10:26.149ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d53f565a-e812-4053-98b4-59c34d29e75c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5642024-12-20T21:10:26.201ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652024-12-20T21:10:26.201ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662024-12-20T21:10:26.201ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d0b1b25-4a74-46a6-945f-18014df947c1/crypt/zone/oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89"), full_name: "oxp_4d0b1b25-4a74-46a6-945f-18014df947c1/crypt/zone/oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89" } file = sled-storage/src/manager.rs:1431
5672024-12-20T21:10:26.259ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682024-12-20T21:10:26.259ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692024-12-20T21:10:26.259ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5702024-12-20T21:10:26.309ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712024-12-20T21:10:26.309ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5722024-12-20T21:10:26.309ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crucible" } file = sled-storage/src/manager.rs:1431
5732024-12-20T21:10:26.357ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742024-12-20T21:10:26.357ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5752024-12-20T21:10:26.357ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone/oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0"), full_name: "oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone/oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0" } file = sled-storage/src/manager.rs:1431
5762024-12-20T21:10:26.419ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772024-12-20T21:10:26.419ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782024-12-20T21:10:26.419ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d53f565a-e812-4053-98b4-59c34d29e75c/crypt/zone/oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c"), full_name: "oxp_d53f565a-e812-4053-98b4-59c34d29e75c/crypt/zone/oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c" } file = sled-storage/src/manager.rs:1431
5792024-12-20T21:10:26.479ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802024-12-20T21:10:26.479ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5812024-12-20T21:10:26.479ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible" } file = sled-storage/src/manager.rs:1431
5822024-12-20T21:10:26.527ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832024-12-20T21:10:26.527ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5842024-12-20T21:10:26.527ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d53f565a-e812-4053-98b4-59c34d29e75c/crypt/zone"), full_name: "oxp_d53f565a-e812-4053-98b4-59c34d29e75c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5852024-12-20T21:10:26.555ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862024-12-20T21:10:26.555ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872024-12-20T21:10:26.555ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/zone/oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf"), full_name: "oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/zone/oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf" } file = sled-storage/src/manager.rs:1431
5882024-12-20T21:10:26.615ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892024-12-20T21:10:26.615ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5902024-12-20T21:10:26.615ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/debug"), full_name: "oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/debug" } file = sled-storage/src/manager.rs:1431
5912024-12-20T21:10:26.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922024-12-20T21:10:26.645ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5932024-12-20T21:10:26.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4d0b1b25-4a74-46a6-945f-18014df947c1/crucible" } file = sled-storage/src/manager.rs:1431
5942024-12-20T21:10:26.661ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9ab49b39-4891-4f63-9152-18cfc9c75d04) file = sled-agent/src/probe_manager.rs:231 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
5952024-12-20T21:10:26.692ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962024-12-20T21:10:26.692ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5972024-12-20T21:10:26.692ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3aaf6321-1f78-413a-aeef-fc748a8d6f94/crypt/debug"), full_name: "oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crypt/debug" } file = sled-storage/src/manager.rs:1431
5982024-12-20T21:10:26.721ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992024-12-20T21:10:26.721ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002024-12-20T21:10:26.721ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d53f565a-e812-4053-98b4-59c34d29e75c/crucible" } file = sled-storage/src/manager.rs:1431
6012024-12-20T21:10:26.768ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022024-12-20T21:10:26.769ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6032024-12-20T21:10:26.769ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone/oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481"), full_name: "oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone/oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481" } file = sled-storage/src/manager.rs:1431
6042024-12-20T21:10:26.828ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052024-12-20T21:10:26.828ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6062024-12-20T21:10:26.828ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d53f565a-e812-4053-98b4-59c34d29e75c/crypt/debug"), full_name: "oxp_d53f565a-e812-4053-98b4-59c34d29e75c/crypt/debug" } file = sled-storage/src/manager.rs:1431
6072024-12-20T21:10:26.857ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082024-12-20T21:10:26.857ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092024-12-20T21:10:26.857ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone/oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/zone/oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641" } file = sled-storage/src/manager.rs:1431
6102024-12-20T21:10:26.917ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112024-12-20T21:10:26.917ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122024-12-20T21:10:26.917ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6132024-12-20T21:10:26.967ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142024-12-20T21:10:26.967ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152024-12-20T21:10:26.967ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crucible" } file = sled-storage/src/manager.rs:1431
6162024-12-20T21:10:27.014ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172024-12-20T21:10:27.014ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182024-12-20T21:10:27.014ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/zone/oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb"), full_name: "oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/zone/oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb" } file = sled-storage/src/manager.rs:1431
6192024-12-20T21:10:27.074ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202024-12-20T21:10:27.074ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212024-12-20T21:10:27.074ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone/oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa"), full_name: "oxp_70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone/oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa" } file = sled-storage/src/manager.rs:1431
6222024-12-20T21:10:27.133ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232024-12-20T21:10:27.133ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242024-12-20T21:10:27.133ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone/oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b"), full_name: "oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/zone/oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b" } file = sled-storage/src/manager.rs:1431
6252024-12-20T21:10:27.193ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262024-12-20T21:10:27.193ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6272024-12-20T21:10:27.193ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone"), full_name: "oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone" } file = sled-storage/src/manager.rs:1431
6282024-12-20T21:10:27.223ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292024-12-20T21:10:27.223ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302024-12-20T21:10:27.223ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6312024-12-20T21:10:27.273ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322024-12-20T21:10:27.273ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6332024-12-20T21:10:27.273ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone/oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8"), full_name: "oxp_70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone/oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8" } file = sled-storage/src/manager.rs:1431
6342024-12-20T21:10:27.333ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352024-12-20T21:10:27.333ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362024-12-20T21:10:27.333ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone/oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc"), full_name: "oxp_70bee423-c23a-4941-9c18-69f4feca1839/crypt/zone/oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc" } file = sled-storage/src/manager.rs:1431
6372024-12-20T21:10:27.393ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382024-12-20T21:10:27.393ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392024-12-20T21:10:27.393ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone/oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276"), full_name: "oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone/oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276" } file = sled-storage/src/manager.rs:1431
6402024-12-20T21:10:27.453ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412024-12-20T21:10:27.453ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422024-12-20T21:10:27.453ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/zone/oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497"), full_name: "oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/zone/oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497" } file = sled-storage/src/manager.rs:1431
6432024-12-20T21:10:27.511ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442024-12-20T21:10:27.511ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6452024-12-20T21:10:27.511ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/debug"), full_name: "oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/debug" } file = sled-storage/src/manager.rs:1431
6462024-12-20T21:10:27.540ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472024-12-20T21:10:27.540ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482024-12-20T21:10:27.540ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/zone/oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac"), full_name: "oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/zone/oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac" } file = sled-storage/src/manager.rs:1431
6492024-12-20T21:10:27.599ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6502024-12-20T21:10:27.599ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6512024-12-20T21:10:27.599ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone/oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), full_name: "oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/zone/oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2" } file = sled-storage/src/manager.rs:1431
6522024-12-20T21:10:27.659ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6532024-12-20T21:10:27.659ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542024-12-20T21:10:27.659ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
6552024-12-20T21:10:27.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3167990 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39081 req_id = 0f15cc64-f50f-4db2-9d8c-c0120437c6cf response_code = 200 uri = /datasets
6562024-12-20T21:10:27.663ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9ab49b39-4891-4f63-9152-18cfc9c75d04) file = sled-agent/src/probe_manager.rs:231 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
6572024-12-20T21:10:27.691ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: f7b9600f-ac39-49a6-b18b-43af5771a4d0 (service), filesystem_pool: Some(ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 6b2f6438-920e-4873-9a07-e36f03cb723b (service), filesystem_pool: Some(ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 728b1191-b6ca-46e9-b83a-1df801c80656 (service), filesystem_pool: Some(ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6582024-12-20T21:10:27.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53644
6592024-12-20T21:10:27.691ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602024-12-20T21:10:27.691ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612024-12-20T21:10:27.700ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622024-12-20T21:10:27.700ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632024-12-20T21:10:27.709ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6642024-12-20T21:10:27.709ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652024-12-20T21:10:27.718ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662024-12-20T21:10:27.718ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-zones.json file = common/src/ledger.rs:188
6672024-12-20T21:10:27.718ZINFOSledAgent (ServiceManager): No ledger in /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-zones.json file = common/src/ledger.rs:188
6682024-12-20T21:10:27.718ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692024-12-20T21:10:27.767ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702024-12-20T21:10:27.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712024-12-20T21:10:27.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722024-12-20T21:10:27.821ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b file = illumos-utils/src/zone.rs:325
6732024-12-20T21:10:27.824ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656 file = illumos-utils/src/zone.rs:325
6742024-12-20T21:10:27.828ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0 file = illumos-utils/src/zone.rs:325
6752024-12-20T21:10:27.841ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b file = illumos-utils/src/zone.rs:363
6762024-12-20T21:10:27.845ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656 file = illumos-utils/src/zone.rs:363
6772024-12-20T21:10:27.849ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0 file = illumos-utils/src/zone.rs:363
6782024-12-20T21:10:28.664ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9ab49b39-4891-4f63-9152-18cfc9c75d04) file = sled-agent/src/probe_manager.rs:231 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
6792024-12-20T21:10:29.440ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-12-20T21:10:29.440ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6812024-12-20T21:10:29.440ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
6822024-12-20T21:10:29.928ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-12-20T21:10:29.928ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6842024-12-20T21:10:30.255ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6852024-12-20T21:10:30.255ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6862024-12-20T21:10:30.261ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6872024-12-20T21:10:30.261ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
6882024-12-20T21:10:30.404ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
6892024-12-20T21:10:30.404ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
6902024-12-20T21:10:30.411ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6912024-12-20T21:10:30.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656") failed: Property not found. retry in 38.10336ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
6922024-12-20T21:10:30.421ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
6932024-12-20T21:10:30.425ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6942024-12-20T21:10:30.425ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
6952024-12-20T21:10:30.451ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
6962024-12-20T21:10:30.451ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
6972024-12-20T21:10:30.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656") failed: Property not found. retry in 97.226367ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
6982024-12-20T21:10:30.487ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2025598021443427647 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
6992024-12-20T21:10:30.487ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15216362659096176165 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
7002024-12-20T21:10:30.513ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
7012024-12-20T21:10:30.513ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
7022024-12-20T21:10:30.533ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
7032024-12-20T21:10:30.533ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
7042024-12-20T21:10:30.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0") failed: Property not found. retry in 43.317893ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
7052024-12-20T21:10:30.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b") failed: Property not found. retry in 31.715567ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
7062024-12-20T21:10:30.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656") failed: Property not found. retry in 123.347949ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
7072024-12-20T21:10:30.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b") failed: Property not found. retry in 126.577918ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
7082024-12-20T21:10:30.606ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
7092024-12-20T21:10:30.606ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
7102024-12-20T21:10:30.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0") failed: Property not found. retry in 133.382338ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
7112024-12-20T21:10:30.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656") failed: Property not found. retry in 406.556685ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
7122024-12-20T21:10:30.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b") failed: Property not found. retry in 279.838757ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
7132024-12-20T21:10:30.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0") failed: Property not found. retry in 103.240381ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
7142024-12-20T21:10:30.988ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
7152024-12-20T21:10:30.988ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7162024-12-20T21:10:31.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0") failed: Property not found. retry in 202.413503ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
7172024-12-20T21:10:31.057ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7182024-12-20T21:10:31.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b") failed: Property not found. retry in 445.690326ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
7192024-12-20T21:10:31.095ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7202024-12-20T21:10:31.095ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7212024-12-20T21:10:31.095ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7222024-12-20T21:10:31.095ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7232024-12-20T21:10:31.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656") failed: Property not found. retry in 834.947459ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
7242024-12-20T21:10:31.139ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7252024-12-20T21:10:31.198ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7262024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7272024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7282024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7292024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7302024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7312024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7322024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7332024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7342024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7352024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7362024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7372024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7382024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7392024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7402024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7412024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7422024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7432024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7442024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7452024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7462024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7472024-12-20T21:10:31.198ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7482024-12-20T21:10:31.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0") failed: Property not found. retry in 480.381257ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
7492024-12-20T21:10:31.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b") failed: Property not found. retry in 474.131323ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
7502024-12-20T21:10:31.590ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11526153984455044204 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
7512024-12-20T21:10:31.590ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16293036310606771885 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
7522024-12-20T21:10:31.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0") failed: Property not found. retry in 751.58008ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
7532024-12-20T21:10:31.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656") failed: Property not found. retry in 571.960595ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
7542024-12-20T21:10:32.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b") failed: Property not found. retry in 563.719021ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
7552024-12-20T21:10:32.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0") failed: Property not found. retry in 1.261348729s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
7562024-12-20T21:10:32.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656") failed: Property not found. retry in 555.180378ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
7572024-12-20T21:10:32.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b") failed: Property not found. retry in 1.30057172s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
7582024-12-20T21:10:33.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656") failed: Property not found. retry in 1.214071432s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
7592024-12-20T21:10:33.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0") failed: Property not found. retry in 1.039339687s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
7602024-12-20T21:10:33.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b") failed: Property not found. retry in 1.324992628s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
7612024-12-20T21:10:34.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656") failed: Property not found. retry in 970.019372ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
7622024-12-20T21:10:34.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0") failed: Property not found. retry in 952.156044ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
7632024-12-20T21:10:35.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b") failed: Property not found. retry in 965.865406ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
7642024-12-20T21:10:36.222ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_6b2f6438-920e-4873-9a07-e36f03cb723b
7652024-12-20T21:10:36.222ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_728b1191-b6ca-46e9-b83a-1df801c80656
7662024-12-20T21:10:36.222ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_f7b9600f-ac39-49a6-b18b-43af5771a4d0
7672024-12-20T21:10:36.222ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682024-12-20T21:10:36.222ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692024-12-20T21:10:36.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8531324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53644 req_id = 943b35e5-ee5a-4d56-891d-b0b0e33a45d6 response_code = 204 uri = /omicron-zones
7702024-12-20T21:10:36.225ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7712024-12-20T21:10:36.268ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 148.302606ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7722024-12-20T21:10:36.432ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732024-12-20T21:10:36.479ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742024-12-20T21:10:36.526ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7752024-12-20T21:10:36.526ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7762024-12-20T21:10:36.557ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7772024-12-20T21:10:36.558ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7782024-12-20T21:10:36.558ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7792024-12-20T21:10:36.587ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: f7b9600f-ac39-49a6-b18b-43af5771a4d0 (service), filesystem_pool: Some(ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 6b2f6438-920e-4873-9a07-e36f03cb723b (service), filesystem_pool: Some(ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 728b1191-b6ca-46e9-b83a-1df801c80656 (service), filesystem_pool: Some(ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 9419f136-a9de-43cb-89d7-9be7cb8d36eb (service), filesystem_pool: Some(ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a805f192-5262-48d5-a0b2-1c6402de4f44, kind: Service { id: 9419f136-a9de-43cb-89d7-9be7cb8d36eb }, name: Name("ntp-9419f136-a9de-43cb-89d7-9be7cb8d36eb"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 182])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7802024-12-20T21:10:36.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54967
7812024-12-20T21:10:36.587ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7822024-12-20T21:10:36.587ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832024-12-20T21:10:36.598ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7842024-12-20T21:10:36.598ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7852024-12-20T21:10:36.607ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7862024-12-20T21:10:36.607ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7872024-12-20T21:10:36.615ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7882024-12-20T21:10:36.615ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-zones.json file = common/src/ledger.rs:177
7892024-12-20T21:10:36.615ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-zones.json file = common/src/ledger.rs:177
7902024-12-20T21:10:36.615ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7912024-12-20T21:10:36.626ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7922024-12-20T21:10:36.659ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7932024-12-20T21:10:36.660ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7942024-12-20T21:10:36.660ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7952024-12-20T21:10:36.690ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 224, 182]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7962024-12-20T21:10:36.690ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7972024-12-20T21:10:36.690ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7982024-12-20T21:10:36.690ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7992024-12-20T21:10:36.690ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
8002024-12-20T21:10:36.691ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8012024-12-20T21:10:36.713ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb file = illumos-utils/src/zone.rs:325
8022024-12-20T21:10:36.731ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb file = illumos-utils/src/zone.rs:363
8032024-12-20T21:10:37.351ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8042024-12-20T21:10:37.351ZINFOSledAgent (ServiceManager): Booting oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8052024-12-20T21:10:37.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb") failed: Property not found. retry in 74.111805ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8062024-12-20T21:10:37.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb") failed: Property not found. retry in 133.306882ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8072024-12-20T21:10:37.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb") failed: Property not found. retry in 241.626722ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8082024-12-20T21:10:37.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb") failed: Property not found. retry in 277.177345ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8092024-12-20T21:10:38.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb") failed: Property not found. retry in 780.275853ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8102024-12-20T21:10:39.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb") failed: Property not found. retry in 961.918506ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8112024-12-20T21:10:40.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb") failed: Property not found. retry in 574.260971ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8122024-12-20T21:10:40.489ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2025598021443427647 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8132024-12-20T21:10:40.489ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15216362659096176165 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8142024-12-20T21:10:40.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb") failed: Property not found. retry in 587.465901ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8152024-12-20T21:10:41.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb") failed: Property not found. retry in 812.947714ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8162024-12-20T21:10:41.592ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11526153984455044204 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8172024-12-20T21:10:41.592ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16293036310606771885 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8182024-12-20T21:10:42.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb") failed: Property not found. retry in 681.229123ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8192024-12-20T21:10:42.723ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb
8202024-12-20T21:10:42.723ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8212024-12-20T21:10:42.724ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8222024-12-20T21:10:42.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6136689 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54967 req_id = 846d60d6-a732-4ecf-bff4-59b68ad55e35 response_code = 204 uri = /omicron-zones
8232024-12-20T21:10:42.726ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8242024-12-20T21:10:42.756ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8252024-12-20T21:10:42.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51161
8262024-12-20T21:10:42.764ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8272024-12-20T21:10:42.764ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7546 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51161 req_id = bfa280f2-bc04-4ed6-9c56-75b54468798d response_code = 500 uri = /timesync
8282024-12-20T21:10:42.766ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8292024-12-20T21:10:42.918ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8302024-12-20T21:10:42.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56205
8312024-12-20T21:10:45.347ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17642969249561674946 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8322024-12-20T21:10:45.782ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 587739271119575748 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8332024-12-20T21:10:46.224ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14257377842265723702 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8342024-12-20T21:10:46.927ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8352024-12-20T21:10:46.927ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009050 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56205 req_id = 91cd4e83-d476-4a50-9085-d54c9ad90e49 response_code = 500 uri = /timesync
8362024-12-20T21:10:46.929ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8372024-12-20T21:10:47.124ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8382024-12-20T21:10:47.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61062
8392024-12-20T21:10:47.133ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8402024-12-20T21:10:47.133ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8528 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61062 req_id = c5ec53fe-c633-4644-b288-59226f09f7f3 response_code = 500 uri = /timesync
8412024-12-20T21:10:47.135ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8422024-12-20T21:10:47.319ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8432024-12-20T21:10:47.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54496
8442024-12-20T21:10:51.024ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2025598021443427647 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8452024-12-20T21:10:51.024ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15216362659096176165 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8462024-12-20T21:10:51.860ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_9419f136-a9de-43cb-89d7-9be7cb8d36eb': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8472024-12-20T21:10:51.861ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008670 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54496 req_id = 60f17e19-fd7b-41aa-a4fb-0af4404ac64f response_code = 500 uri = /timesync
8482024-12-20T21:10:51.864ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8492024-12-20T21:10:52.122ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8502024-12-20T21:10:52.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40231
8512024-12-20T21:10:52.128ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11526153984455044204 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8522024-12-20T21:10:52.128ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16293036310606771885 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8532024-12-20T21:10:52.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8763 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40231 req_id = b34c9165-8f4d-4d19-870d-47d880bed8bc response_code = 200 uri = /timesync
8542024-12-20T21:10:52.133ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.047433067 } file = sled-agent/src/rack_setup/service.rs:743
8552024-12-20T21:10:52.133ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8562024-12-20T21:10:52.277ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572024-12-20T21:10:52.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47975
8582024-12-20T21:10:52.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7731 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47975 req_id = d95be864-cb01-4fe0-a16a-a8765da2b084 response_code = 200 uri = /timesync
8592024-12-20T21:10:52.289ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.047014676 } file = sled-agent/src/rack_setup/service.rs:743
8602024-12-20T21:10:52.289ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612024-12-20T21:10:52.567ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8622024-12-20T21:10:52.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49561
8632024-12-20T21:10:52.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7592 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49561 req_id = 7f55a381-1f5f-41ca-9912-efe7254b1790 response_code = 200 uri = /timesync
8642024-12-20T21:10:52.577ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.056965731 } file = sled-agent/src/rack_setup/service.rs:743
8652024-12-20T21:10:52.577ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8662024-12-20T21:10:52.840ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8672024-12-20T21:10:52.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54045
8682024-12-20T21:10:52.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54045 req_id = c02980dd-542b-47aa-973a-2a23d27daabf response_code = 200 uri = /timesync
8692024-12-20T21:10:52.850ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.056223311 } file = sled-agent/src/rack_setup/service.rs:743
8702024-12-20T21:10:52.850ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8712024-12-20T21:10:53.156ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8722024-12-20T21:10:53.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37922
8732024-12-20T21:10:53.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7894 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37922 req_id = 2913abf5-f2e6-403d-b805-06909ad6dbf8 response_code = 200 uri = /timesync
8742024-12-20T21:10:53.167ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.05536532 } file = sled-agent/src/rack_setup/service.rs:743
8752024-12-20T21:10:53.167ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8762024-12-20T21:10:53.257ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1479366510393756326 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8772024-12-20T21:10:53.257ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15088123742916746079 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
8782024-12-20T21:10:53.558ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8792024-12-20T21:10:53.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45022
8802024-12-20T21:10:53.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7923 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45022 req_id = 029646ac-6583-4220-9f37-c49e973d7a9a response_code = 200 uri = /timesync
8812024-12-20T21:10:53.568ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.051356401 } file = sled-agent/src/rack_setup/service.rs:743
8822024-12-20T21:10:53.568ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8832024-12-20T21:10:53.970ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8842024-12-20T21:10:53.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56884
8852024-12-20T21:10:53.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7854 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56884 req_id = adc15337-81e9-423d-be37-d57a5e21bb8c response_code = 200 uri = /timesync
8862024-12-20T21:10:53.979ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.050240304 } file = sled-agent/src/rack_setup/service.rs:743
8872024-12-20T21:10:53.979ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8882024-12-20T21:10:54.361ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8892024-12-20T21:10:54.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48063
8902024-12-20T21:10:54.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7553 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48063 req_id = ca060d3e-948a-41ce-b9bf-32090fbf2fea response_code = 200 uri = /timesync
8912024-12-20T21:10:54.372ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.049177755 } file = sled-agent/src/rack_setup/service.rs:743
8922024-12-20T21:10:54.372ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8932024-12-20T21:10:55.508ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8942024-12-20T21:10:55.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50958
8952024-12-20T21:10:55.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50958 req_id = 2ecdf7b3-cb3d-476a-8ab7-6e29ca51741d response_code = 200 uri = /timesync
8962024-12-20T21:10:55.532ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3628216362, ip_addr: 216.66.48.42, stratum: 2, ref_time: 1734729054.943725, correction: -0.042119991 } file = sled-agent/src/rack_setup/service.rs:743
8972024-12-20T21:10:55.532ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8982024-12-20T21:10:55.561ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: f7b9600f-ac39-49a6-b18b-43af5771a4d0 (service), filesystem_pool: Some(ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 6b2f6438-920e-4873-9a07-e36f03cb723b (service), filesystem_pool: Some(ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 728b1191-b6ca-46e9-b83a-1df801c80656 (service), filesystem_pool: Some(ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 9419f136-a9de-43cb-89d7-9be7cb8d36eb (service), filesystem_pool: Some(ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a805f192-5262-48d5-a0b2-1c6402de4f44, kind: Service { id: 9419f136-a9de-43cb-89d7-9be7cb8d36eb }, name: Name("ntp-9419f136-a9de-43cb-89d7-9be7cb8d36eb"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 182])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 20350105-4d7b-48a5-a431-98fdbdf38641 (service), filesystem_pool: Some(ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3ec0ad6b-ce94-477f-9067-adc4111db931 (service), filesystem_pool: Some(ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External } } } }, OmicronZoneConfig { id: b54ffb4e-111c-434d-862d-2ee7fa2580c8 (service), filesystem_pool: Some(ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External } } } }, OmicronZoneConfig { id: ba26d958-7754-4d5f-849b-ad42c00be42c (service), filesystem_pool: Some(ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External } } } }, OmicronZoneConfig { id: 4d440a74-8411-4840-8944-a125af35aecf (service), filesystem_pool: Some(ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8992024-12-20T21:10:55.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35062
9002024-12-20T21:10:55.562ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9012024-12-20T21:10:55.562ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9022024-12-20T21:10:55.571ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9032024-12-20T21:10:55.571ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9042024-12-20T21:10:55.580ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9052024-12-20T21:10:55.580ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9062024-12-20T21:10:55.590ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9072024-12-20T21:10:55.590ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9082024-12-20T21:10:55.598ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9092024-12-20T21:10:55.598ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9102024-12-20T21:10:55.606ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9112024-12-20T21:10:55.606ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9122024-12-20T21:10:55.613ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9132024-12-20T21:10:55.613ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Cockroach }, responder: ... }
9142024-12-20T21:10:55.621ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9152024-12-20T21:10:55.621ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9162024-12-20T21:10:55.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9172024-12-20T21:10:55.629ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-zones.json file = common/src/ledger.rs:177
9182024-12-20T21:10:55.629ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-zones.json file = common/src/ledger.rs:177
9192024-12-20T21:10:55.630ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9202024-12-20T21:10:55.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9212024-12-20T21:10:55.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9222024-12-20T21:10:55.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9232024-12-20T21:10:55.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9242024-12-20T21:10:55.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9252024-12-20T21:10:55.791ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931 file = illumos-utils/src/zone.rs:325
9262024-12-20T21:10:55.795ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 file = illumos-utils/src/zone.rs:325
9272024-12-20T21:10:55.799ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf file = illumos-utils/src/zone.rs:325
9282024-12-20T21:10:55.802ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c file = illumos-utils/src/zone.rs:325
9292024-12-20T21:10:55.806ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8 file = illumos-utils/src/zone.rs:325
9302024-12-20T21:10:55.811ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931 file = illumos-utils/src/zone.rs:363
9312024-12-20T21:10:55.817ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 file = illumos-utils/src/zone.rs:363
9322024-12-20T21:10:55.821ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf file = illumos-utils/src/zone.rs:363
9332024-12-20T21:10:55.826ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8 file = illumos-utils/src/zone.rs:363
9342024-12-20T21:10:55.830ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c file = illumos-utils/src/zone.rs:363
9352024-12-20T21:10:56.493ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 332.824091ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
9362024-12-20T21:10:59.485ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='20350105-4d7b-48a5-a431-98fdbdf38641'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9372024-12-20T21:10:59.485ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9382024-12-20T21:10:59.491ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4d440a74-8411-4840-8944-a125af35aecf'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9392024-12-20T21:10:59.491ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9402024-12-20T21:10:59.526ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ba26d958-7754-4d5f-849b-ad42c00be42c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9412024-12-20T21:10:59.526ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
9422024-12-20T21:10:59.598ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3ec0ad6b-ce94-477f-9067-adc4111db931'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9432024-12-20T21:10:59.598ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9442024-12-20T21:10:59.611ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b54ffb4e-111c-434d-862d-2ee7fa2580c8'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9452024-12-20T21:10:59.611ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9462024-12-20T21:10:59.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 39.097102ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9472024-12-20T21:10:59.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 42.452945ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9482024-12-20T21:10:59.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 30.86429ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
9492024-12-20T21:10:59.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 57.318912ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9502024-12-20T21:10:59.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 140.215459ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9512024-12-20T21:10:59.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 76.715884ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
9522024-12-20T21:10:59.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 60.689045ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9532024-12-20T21:10:59.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 216.883181ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9542024-12-20T21:10:59.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 45.987523ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9552024-12-20T21:10:59.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 237.245341ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
9562024-12-20T21:10:59.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 145.380403ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9572024-12-20T21:10:59.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 122.27166ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9582024-12-20T21:10:59.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 136.294992ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9592024-12-20T21:10:59.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 172.310109ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9602024-12-20T21:10:59.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 251.896795ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9612024-12-20T21:10:59.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 418.314174ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9622024-12-20T21:10:59.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 345.241766ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9632024-12-20T21:11:00.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 594.364068ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
9642024-12-20T21:11:00.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 507.46816ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9652024-12-20T21:11:00.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 357.072832ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9662024-12-20T21:11:00.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 607.09027ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9672024-12-20T21:11:00.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 783.168871ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9682024-12-20T21:11:00.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 940.68411ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9692024-12-20T21:11:00.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 756.454452ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9702024-12-20T21:11:01.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 962.600374ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
9712024-12-20T21:11:01.247ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53261
9722024-12-20T21:11:01.248ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53261 req_id = e8e445fa-9965-4094-94da-5d4e04db882f response_code = 200 uri = /baseboard
9732024-12-20T21:11:01.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 1.282900137s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9742024-12-20T21:11:01.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 731.031029ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9752024-12-20T21:11:01.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 954.684564ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9762024-12-20T21:11:01.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 901.478643ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9772024-12-20T21:11:02.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 677.880308ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9782024-12-20T21:11:02.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 547.459605ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
9792024-12-20T21:11:02.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 1.125861384s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9802024-12-20T21:11:02.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 1.136337036s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9812024-12-20T21:11:02.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 780.550346ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9822024-12-20T21:11:02.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 924.105234ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9832024-12-20T21:11:02.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 1.202576971s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
9842024-12-20T21:11:03.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 505.391723ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9852024-12-20T21:11:03.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 722.906148ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9862024-12-20T21:11:03.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 678.32315ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9872024-12-20T21:11:03.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 538.218545ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9882024-12-20T21:11:03.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 1.346291995s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9892024-12-20T21:11:03.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 970.255276ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
9902024-12-20T21:11:04.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 577.075764ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9912024-12-20T21:11:04.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 506.585918ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9922024-12-20T21:11:04.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 1.089041444s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9932024-12-20T21:11:04.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 690.017932ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9942024-12-20T21:11:04.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 937.596645ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
9952024-12-20T21:11:04.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 1.358721018s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
9962024-12-20T21:11:05.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 1.20710647s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
9972024-12-20T21:11:05.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 526.202768ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
9982024-12-20T21:11:05.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 734.551812ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
9992024-12-20T21:11:05.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 1.215220784s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
10002024-12-20T21:11:05.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 737.885687ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
10012024-12-20T21:11:06.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 1.073816056s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
10022024-12-20T21:11:06.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 1.3406721s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
10032024-12-20T21:11:06.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 1.136348825s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
10042024-12-20T21:11:06.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 1.002507235s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
10052024-12-20T21:11:06.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 1.004120956s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
10062024-12-20T21:11:07.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 1.467575543s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
10072024-12-20T21:11:07.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 955.328169ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
10082024-12-20T21:11:07.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 873.624292ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
10092024-12-20T21:11:07.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 941.649291ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
10102024-12-20T21:11:07.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 533.472123ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
10112024-12-20T21:11:08.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 1.120660683s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
10122024-12-20T21:11:08.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 1.304818065s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
10132024-12-20T21:11:08.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 1.186726704s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
10142024-12-20T21:11:08.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 890.864591ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
10152024-12-20T21:11:08.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 724.090397ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
10162024-12-20T21:11:09.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 595.98221ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
10172024-12-20T21:11:09.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 713.721426ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
10182024-12-20T21:11:09.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 1.077649986s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
10192024-12-20T21:11:09.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 1.185132541s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
10202024-12-20T21:11:09.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 1.040842498s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
10212024-12-20T21:11:10.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 518.212539ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
10222024-12-20T21:11:10.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 1.065767083s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
10232024-12-20T21:11:10.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 1.266621777s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
10242024-12-20T21:11:10.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 1.044974916s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
10252024-12-20T21:11:10.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 825.875514ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
10262024-12-20T21:11:10.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 727.711546ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
10272024-12-20T21:11:11.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 1.312333566s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
10282024-12-20T21:11:11.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 1.409514693s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
10292024-12-20T21:11:11.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 1.103190813s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
10302024-12-20T21:11:11.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 635.450929ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
10312024-12-20T21:11:11.822ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 474.690341ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
10322024-12-20T21:11:11.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 596.38726ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
10332024-12-20T21:11:12.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 807.489596ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
10342024-12-20T21:11:12.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf") failed: Property not found. retry in 1.348721419s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
10352024-12-20T21:11:12.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 529.219488ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
10362024-12-20T21:11:12.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8") failed: Property not found. retry in 1.071569676s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
10372024-12-20T21:11:13.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c") failed: Property not found. retry in 791.390235ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
10382024-12-20T21:11:13.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931") failed: Property not found. retry in 1.02714795s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
10392024-12-20T21:11:13.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641") failed: Property not found. retry in 649.138109ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
10402024-12-20T21:11:14.237ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_b54ffb4e-111c-434d-862d-2ee7fa2580c8
10412024-12-20T21:11:14.238ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_3ec0ad6b-ce94-477f-9067-adc4111db931
10422024-12-20T21:11:14.238ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641
10432024-12-20T21:11:14.238ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_4d440a74-8411-4840-8944-a125af35aecf
10442024-12-20T21:11:14.238ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_ba26d958-7754-4d5f-849b-ad42c00be42c
10452024-12-20T21:11:14.238ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10462024-12-20T21:11:14.238ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10472024-12-20T21:11:14.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18719253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35062 req_id = b6609efa-f24a-4e99-88cd-8e80ce1478d2 response_code = 204 uri = /omicron-zones
10482024-12-20T21:11:14.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37840
10492024-12-20T21:11:14.303ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 31496 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = 81a20c3f-3f7e-4344-8456-a31534b9ad10 response_code = 500 uri = /cockroachdb
10502024-12-20T21:11:14.304ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "81a20c3f-3f7e-4344-8456-a31534b9ad10", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "81a20c3f-3f7e-4344-8456-a31534b9ad10" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 74.159256ms
10512024-12-20T21:11:14.404ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25540 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = 1bdad714-db3d-4c2f-8739-30a45ffe9363 response_code = 500 uri = /cockroachdb
10522024-12-20T21:11:14.404ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1bdad714-db3d-4c2f-8739-30a45ffe9363", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1bdad714-db3d-4c2f-8739-30a45ffe9363" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 79.265258ms
10532024-12-20T21:11:14.509ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 24631 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = 424c61e1-6a98-466a-be0a-f1ba6db3e4a8 response_code = 500 uri = /cockroachdb
10542024-12-20T21:11:14.509ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "424c61e1-6a98-466a-be0a-f1ba6db3e4a8", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "424c61e1-6a98-466a-be0a-f1ba6db3e4a8" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 128.020954ms
10552024-12-20T21:11:14.666ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27348 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = 972218bc-d1cc-4be8-93b3-ba82a71b7519 response_code = 500 uri = /cockroachdb
10562024-12-20T21:11:14.666ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "972218bc-d1cc-4be8-93b3-ba82a71b7519", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "972218bc-d1cc-4be8-93b3-ba82a71b7519" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 255.70961ms
10572024-12-20T21:11:14.949ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26861 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = 460b8649-429f-4627-a687-5724ffdb0052 response_code = 500 uri = /cockroachdb
10582024-12-20T21:11:14.950ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "460b8649-429f-4627-a687-5724ffdb0052", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "460b8649-429f-4627-a687-5724ffdb0052" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 125.45709ms
10592024-12-20T21:11:15.103ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = 7455f306-b5da-41a1-9eb5-96b54e4b0f97 response_code = 500 uri = /cockroachdb
10602024-12-20T21:11:15.103ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7455f306-b5da-41a1-9eb5-96b54e4b0f97", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7455f306-b5da-41a1-9eb5-96b54e4b0f97" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 264.180347ms
10612024-12-20T21:11:15.396ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = b3dae713-c7fa-439b-a649-325718e31662 response_code = 500 uri = /cockroachdb
10622024-12-20T21:11:15.396ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b3dae713-c7fa-439b-a649-325718e31662", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b3dae713-c7fa-439b-a649-325718e31662" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 156.853783ms
10632024-12-20T21:11:15.580ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25918 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = 62473e97-baa0-444e-9afe-e96350dd1f64 response_code = 500 uri = /cockroachdb
10642024-12-20T21:11:15.581ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "62473e97-baa0-444e-9afe-e96350dd1f64", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "62473e97-baa0-444e-9afe-e96350dd1f64" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 198.876462ms
10652024-12-20T21:11:15.806ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25161 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = c186a3ae-96e9-419e-8680-8344ec504d10 response_code = 500 uri = /cockroachdb
10662024-12-20T21:11:15.806ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c186a3ae-96e9-419e-8680-8344ec504d10", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c186a3ae-96e9-419e-8680-8344ec504d10" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 331.797253ms
10672024-12-20T21:11:16.165ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25884 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = 58f71d35-7be9-4567-be87-e352406a30a0 response_code = 500 uri = /cockroachdb
10682024-12-20T21:11:16.165ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "58f71d35-7be9-4567-be87-e352406a30a0", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "58f71d35-7be9-4567-be87-e352406a30a0" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 337.346312ms
10692024-12-20T21:11:16.529ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25282 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = 54925c3d-a6a3-47ff-851b-1204d7a20e06 response_code = 500 uri = /cockroachdb
10702024-12-20T21:11:16.529ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "54925c3d-a6a3-47ff-851b-1204d7a20e06", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "54925c3d-a6a3-47ff-851b-1204d7a20e06" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 888.220237ms
10712024-12-20T21:11:17.446ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_20350105-4d7b-48a5-a431-98fdbdf38641 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = b7045073-e376-498c-b72e-26d465642ef7 response_code = 500 uri = /cockroachdb
10722024-12-20T21:11:17.446ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b7045073-e376-498c-b72e-26d465642ef7", "content-length": "124", "date": "Fri, 20 Dec 2024 21:11:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b7045073-e376-498c-b72e-26d465642ef7" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 674.102537ms
10732024-12-20T21:11:18.151ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3758
10742024-12-20T21:11:39.173ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
10752024-12-20T21:11:45.693ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
10762024-12-20T21:11:45.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27574760 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37840 req_id = aef36271-324c-4160-a110-de15aee284da response_code = 204 uri = /cockroachdb
10772024-12-20T21:11:45.698ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61876
10782024-12-20T21:11:45.698ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61876 req_id = 02d38aff-862b-4178-96ec-56ca38c7dfca response_code = 200 uri = /baseboard
10792024-12-20T21:11:45.711ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.305509171s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
10802024-12-20T21:11:45.750ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: f7b9600f-ac39-49a6-b18b-43af5771a4d0 (service), filesystem_pool: Some(ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 6b2f6438-920e-4873-9a07-e36f03cb723b (service), filesystem_pool: Some(ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 728b1191-b6ca-46e9-b83a-1df801c80656 (service), filesystem_pool: Some(ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 9419f136-a9de-43cb-89d7-9be7cb8d36eb (service), filesystem_pool: Some(ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a805f192-5262-48d5-a0b2-1c6402de4f44, kind: Service { id: 9419f136-a9de-43cb-89d7-9be7cb8d36eb }, name: Name("ntp-9419f136-a9de-43cb-89d7-9be7cb8d36eb"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 182])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 20350105-4d7b-48a5-a431-98fdbdf38641 (service), filesystem_pool: Some(ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3ec0ad6b-ce94-477f-9067-adc4111db931 (service), filesystem_pool: Some(ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External } } } }, OmicronZoneConfig { id: b54ffb4e-111c-434d-862d-2ee7fa2580c8 (service), filesystem_pool: Some(ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External } } } }, OmicronZoneConfig { id: ba26d958-7754-4d5f-849b-ad42c00be42c (service), filesystem_pool: Some(ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External } } } }, OmicronZoneConfig { id: 4d440a74-8411-4840-8944-a125af35aecf (service), filesystem_pool: Some(ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 (service), filesystem_pool: Some(ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 146c78a1-4090-415b-a726-0fab63981481 (service), filesystem_pool: Some(ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 00388d64-9eba-4119-a557-78f9dac1d369 (service), filesystem_pool: Some(ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 (service), filesystem_pool: Some(ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 (service), filesystem_pool: Some(ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: f1085f8d-9892-4366-b54e-5e861c410b71 (service), filesystem_pool: Some(ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: ad8ba988-04b3-431c-9de9-181f31cefa9f (service), filesystem_pool: Some(ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External } } } }, OmicronZoneConfig { id: 75b5a577-2bb7-4181-95b9-c53983e5bbbc (service), filesystem_pool: Some(ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 370be31d-7959-481f-8868-85802c25d2e4 (service), filesystem_pool: Some(ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: f63aaed9-c1ac-4da1-8ea8-97657d726276 (service), filesystem_pool: Some(ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4 (service), filesystem_pool: Some(ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External } } } }, OmicronZoneConfig { id: 51a04160-e997-4230-9ab3-89d07898a9e0 (service), filesystem_pool: Some(ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External } } } }, OmicronZoneConfig { id: d76d6b77-e70a-49c4-bea4-f8de37be62aa (service), filesystem_pool: Some(ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External } } } }, OmicronZoneConfig { id: 63f7887d-76c9-468f-a0a3-27dfe82d1cb4 (service), filesystem_pool: Some(ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External } } } }, OmicronZoneConfig { id: 86716406-3842-4388-afaa-f7683f7c950f (service), filesystem_pool: Some(ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External } } } }, OmicronZoneConfig { id: f8384d9e-d33e-4c2e-a1d2-93392d74ac89 (service), filesystem_pool: Some(ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2ce89eef-7010-4d0d-91b1-35192322c0ac (service), filesystem_pool: Some(ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 137427fe-5d65-4543-802c-a51a414d705e (service), filesystem_pool: Some(ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External } } } }, OmicronZoneConfig { id: 42e0a324-3b38-4eb7-a588-ce1de2417f9b (service), filesystem_pool: Some(ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10812024-12-20T21:11:45.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42629
10822024-12-20T21:11:45.752ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10832024-12-20T21:11:45.752ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10842024-12-20T21:11:45.766ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10852024-12-20T21:11:45.766ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10862024-12-20T21:11:45.776ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10872024-12-20T21:11:45.776ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10882024-12-20T21:11:45.786ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10892024-12-20T21:11:45.786ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10902024-12-20T21:11:45.796ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10912024-12-20T21:11:45.796ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10922024-12-20T21:11:45.804ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10932024-12-20T21:11:45.804ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10942024-12-20T21:11:45.813ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10952024-12-20T21:11:45.813ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Cockroach }, responder: ... }
10962024-12-20T21:11:45.822ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10972024-12-20T21:11:45.822ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10982024-12-20T21:11:45.831ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10992024-12-20T21:11:45.831ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11002024-12-20T21:11:45.840ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11012024-12-20T21:11:45.840ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11022024-12-20T21:11:45.851ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11032024-12-20T21:11:45.851ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11042024-12-20T21:11:45.861ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11052024-12-20T21:11:45.861ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, kind: Crucible }, responder: ... }
11062024-12-20T21:11:45.871ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11072024-12-20T21:11:45.871ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, kind: Crucible }, responder: ... }
11082024-12-20T21:11:45.881ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11092024-12-20T21:11:45.881ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, kind: Crucible }, responder: ... }
11102024-12-20T21:11:45.891ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11112024-12-20T21:11:45.891ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, kind: Crucible }, responder: ... }
11122024-12-20T21:11:45.901ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11132024-12-20T21:11:45.901ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, kind: Crucible }, responder: ... }
11142024-12-20T21:11:45.924ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11152024-12-20T21:11:45.924ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, kind: Crucible }, responder: ... }
11162024-12-20T21:11:45.934ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11172024-12-20T21:11:45.934ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, kind: Crucible }, responder: ... }
11182024-12-20T21:11:45.944ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11192024-12-20T21:11:45.944ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, kind: Crucible }, responder: ... }
11202024-12-20T21:11:45.954ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11212024-12-20T21:11:45.954ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, kind: Crucible }, responder: ... }
11222024-12-20T21:11:45.963ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11232024-12-20T21:11:45.963ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-zones.json file = common/src/ledger.rs:177
11242024-12-20T21:11:45.964ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-zones.json file = common/src/ledger.rs:177
11252024-12-20T21:11:45.964ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11262024-12-20T21:11:46.088ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11272024-12-20T21:11:46.088ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282024-12-20T21:11:46.088ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11292024-12-20T21:11:46.100ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11302024-12-20T21:11:46.101ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11312024-12-20T21:11:46.102ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11322024-12-20T21:11:46.161ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11332024-12-20T21:11:46.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11342024-12-20T21:11:46.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11352024-12-20T21:11:46.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11362024-12-20T21:11:46.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11372024-12-20T21:11:46.336ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11382024-12-20T21:11:46.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11392024-12-20T21:11:46.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11402024-12-20T21:11:46.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11412024-12-20T21:11:46.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11422024-12-20T21:11:46.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11432024-12-20T21:11:46.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11442024-12-20T21:11:46.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11452024-12-20T21:11:46.348ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276 file = illumos-utils/src/zone.rs:325
11462024-12-20T21:11:46.353ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f file = illumos-utils/src/zone.rs:325
11472024-12-20T21:11:46.359ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa file = illumos-utils/src/zone.rs:325
11482024-12-20T21:11:46.364ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac file = illumos-utils/src/zone.rs:325
11492024-12-20T21:11:46.370ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b file = illumos-utils/src/zone.rs:325
11502024-12-20T21:11:46.375ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4 file = illumos-utils/src/zone.rs:325
11512024-12-20T21:11:46.380ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e file = illumos-utils/src/zone.rs:325
11522024-12-20T21:11:46.515ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276 file = illumos-utils/src/zone.rs:363
11532024-12-20T21:11:46.520ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f file = illumos-utils/src/zone.rs:363
11542024-12-20T21:11:46.525ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa file = illumos-utils/src/zone.rs:363
11552024-12-20T21:11:46.530ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac file = illumos-utils/src/zone.rs:363
11562024-12-20T21:11:46.534ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b file = illumos-utils/src/zone.rs:363
11572024-12-20T21:11:46.539ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4 file = illumos-utils/src/zone.rs:363
11582024-12-20T21:11:46.544ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e file = illumos-utils/src/zone.rs:363
11592024-12-20T21:11:46.549ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0 file = illumos-utils/src/zone.rs:325
11602024-12-20T21:11:46.554ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4 file = illumos-utils/src/zone.rs:325
11612024-12-20T21:11:46.559ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71 file = illumos-utils/src/zone.rs:325
11622024-12-20T21:11:46.564ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc file = illumos-utils/src/zone.rs:325
11632024-12-20T21:11:46.569ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4 file = illumos-utils/src/zone.rs:325
11642024-12-20T21:11:46.575ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f file = illumos-utils/src/zone.rs:325
11652024-12-20T21:11:46.580ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89 file = illumos-utils/src/zone.rs:325
11662024-12-20T21:11:46.643ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11672024-12-20T21:11:46.644ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0 file = illumos-utils/src/zone.rs:363
11682024-12-20T21:11:46.652ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4 file = illumos-utils/src/zone.rs:363
11692024-12-20T21:11:46.659ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71 file = illumos-utils/src/zone.rs:363
11702024-12-20T21:11:46.666ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc file = illumos-utils/src/zone.rs:363
11712024-12-20T21:11:46.673ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4 file = illumos-utils/src/zone.rs:363
11722024-12-20T21:11:46.687ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f file = illumos-utils/src/zone.rs:363
11732024-12-20T21:11:46.695ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89 file = illumos-utils/src/zone.rs:363
11742024-12-20T21:11:46.761ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11752024-12-20T21:11:46.820ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11762024-12-20T21:11:46.884ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11772024-12-20T21:11:46.958ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11782024-12-20T21:11:46.969ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11792024-12-20T21:11:46.969ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11802024-12-20T21:11:47.030ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 158, 62]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11812024-12-20T21:11:47.030ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11822024-12-20T21:11:47.031ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11832024-12-20T21:11:47.031ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11842024-12-20T21:11:47.119ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 224, 135]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11852024-12-20T21:11:47.119ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11862024-12-20T21:11:47.120ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11872024-12-20T21:11:47.120ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11882024-12-20T21:11:47.177ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 217, 86]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11892024-12-20T21:11:47.177ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11902024-12-20T21:11:47.179ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11912024-12-20T21:11:47.179ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11922024-12-20T21:11:47.253ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 166, 215]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11932024-12-20T21:11:47.253ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11942024-12-20T21:11:47.254ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11952024-12-20T21:11:47.254ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11962024-12-20T21:11:47.327ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 171, 236]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11972024-12-20T21:11:47.327ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11982024-12-20T21:11:47.340ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11992024-12-20T21:11:47.340ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12002024-12-20T21:11:47.346ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12012024-12-20T21:11:47.346ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12022024-12-20T21:11:47.346ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12032024-12-20T21:11:47.346ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12042024-12-20T21:11:47.348ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12052024-12-20T21:11:47.348ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12062024-12-20T21:11:47.379ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12072024-12-20T21:11:47.381ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12082024-12-20T21:11:47.430ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12092024-12-20T21:11:47.430ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12102024-12-20T21:11:47.430ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12112024-12-20T21:11:47.434ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12122024-12-20T21:11:47.439ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12132024-12-20T21:11:47.439ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12142024-12-20T21:11:47.439ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12152024-12-20T21:11:47.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12162024-12-20T21:11:47.442ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12172024-12-20T21:11:47.670ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2 file = illumos-utils/src/zone.rs:325
12182024-12-20T21:11:47.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12192024-12-20T21:11:47.726ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369 file = illumos-utils/src/zone.rs:325
12202024-12-20T21:11:47.732ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497 file = illumos-utils/src/zone.rs:325
12212024-12-20T21:11:47.743ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481 file = illumos-utils/src/zone.rs:325
12222024-12-20T21:11:47.751ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2 file = illumos-utils/src/zone.rs:363
12232024-12-20T21:11:47.762ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35 file = illumos-utils/src/zone.rs:325
12242024-12-20T21:11:47.775ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369 file = illumos-utils/src/zone.rs:363
12252024-12-20T21:11:47.784ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497 file = illumos-utils/src/zone.rs:363
12262024-12-20T21:11:47.792ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481 file = illumos-utils/src/zone.rs:363
12272024-12-20T21:11:47.807ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35 file = illumos-utils/src/zone.rs:363
12282024-12-20T21:11:49.963ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12292024-12-20T21:11:49.965ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
12302024-12-20T21:11:50.043ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='34c82cbe-8895-4fde-be4e-c0790ac9ca18'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12312024-12-20T21:11:50.043ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bc055f20-474c-4173-bcc4-7574cf30e4bd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12322024-12-20T21:11:50.043ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
12332024-12-20T21:11:50.046ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d53f565a-e812-4053-98b4-59c34d29e75c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='30a32862-26e6-4dab-b2f5-5368327e69c1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342024-12-20T21:11:50.046ZINFOSledAgent (ServiceManager): Booting oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
12352024-12-20T21:11:50.052ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4d0b1b25-4a74-46a6-945f-18014df947c1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dfe3d22b-60f6-41fa-81d5-5b8405f6871a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12362024-12-20T21:11:50.053ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='85b0b13b-4f7c-4afe-aa28-40703c929b0e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12372024-12-20T21:11:50.053ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c0443382-b269-427d-9a82-141e4791a6cd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12382024-12-20T21:11:50.053ZINFOSledAgent (ServiceManager): Booting oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
12392024-12-20T21:11:50.058ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
12402024-12-20T21:11:50.064ZINFOSledAgent (ServiceManager): Booting oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
12412024-12-20T21:11:50.070ZINFOSledAgent (ServiceManager): Booting oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
12422024-12-20T21:11:50.077ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='94ee3ab6-4692-44cd-b650-18374a072c4c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12432024-12-20T21:11:50.077ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
12442024-12-20T21:11:50.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 43.396792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
12452024-12-20T21:11:50.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 30.773649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
12462024-12-20T21:11:50.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 70.356124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
12472024-12-20T21:11:50.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 55.877555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
12482024-12-20T21:11:50.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 43.171391ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
12492024-12-20T21:11:50.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 28.821113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
12502024-12-20T21:11:50.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 121.39922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
12512024-12-20T21:11:50.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 115.852535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
12522024-12-20T21:11:50.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 41.846957ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
12532024-12-20T21:11:50.453ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12542024-12-20T21:11:50.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 43.981725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
12552024-12-20T21:11:50.924ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
12562024-12-20T21:11:51.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 84.601427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
12572024-12-20T21:11:51.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 79.835681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
12582024-12-20T21:11:51.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 129.097199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
12592024-12-20T21:11:51.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 82.33654ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
12602024-12-20T21:11:51.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 69.929718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
12612024-12-20T21:11:51.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 144.038985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
12622024-12-20T21:11:51.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 267.109424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
12632024-12-20T21:11:51.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 59.942717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
12642024-12-20T21:11:51.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 272.674258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
12652024-12-20T21:11:51.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 142.831106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
12662024-12-20T21:11:51.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 110.006748ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
12672024-12-20T21:11:51.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 213.840255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
12682024-12-20T21:11:51.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 153.760625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
12692024-12-20T21:11:51.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 433.608907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
12702024-12-20T21:11:51.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 423.053785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
12712024-12-20T21:11:51.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 268.669224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
12722024-12-20T21:11:51.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 71.795536ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
12732024-12-20T21:11:51.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 563.677419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
12742024-12-20T21:11:51.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 528.007885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
12752024-12-20T21:11:51.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 540.173286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
12762024-12-20T21:11:51.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 61.073546ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
12772024-12-20T21:11:51.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 557.278551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
12782024-12-20T21:11:51.987ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6cbb0b58-4d44-45b0-895e-d80165779045/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6c8c17c3-0511-4be9-9328-8195ee502c88'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12792024-12-20T21:11:51.988ZINFOSledAgent (ServiceManager): Booting oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
12802024-12-20T21:11:52.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 487.531622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
12812024-12-20T21:11:52.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 100.53814ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
12822024-12-20T21:11:52.045ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12832024-12-20T21:11:52.049ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
12842024-12-20T21:11:52.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 264.802721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
12852024-12-20T21:11:52.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 499.863567ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
12862024-12-20T21:11:52.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 490.042757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
12872024-12-20T21:11:52.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 420.976568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
12882024-12-20T21:11:52.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 793.326273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
12892024-12-20T21:11:52.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 877.532291ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
12902024-12-20T21:11:52.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 515.58329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
12912024-12-20T21:11:52.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 557.084555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
12922024-12-20T21:11:52.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 713.853403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
12932024-12-20T21:11:52.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 794.423846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
12942024-12-20T21:11:52.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 775.27706ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
12952024-12-20T21:11:52.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 769.998249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
12962024-12-20T21:11:52.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 890.228462ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
12972024-12-20T21:11:52.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 826.681556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
12982024-12-20T21:11:52.999ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12992024-12-20T21:11:52.999ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13002024-12-20T21:11:53.000ZINFOSledAgent (ServiceManager): Booting oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
13012024-12-20T21:11:53.008ZINFOSledAgent (ServiceManager): Booting oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
13022024-12-20T21:11:53.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 537.238845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
13032024-12-20T21:11:53.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 55.387893ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
13042024-12-20T21:11:53.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 1.25747314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
13052024-12-20T21:11:53.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 74.556317ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
13062024-12-20T21:11:53.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 1.011876642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
13072024-12-20T21:11:53.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 145.743743ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
13082024-12-20T21:11:53.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 142.19807ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
13092024-12-20T21:11:53.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 1.464802248s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
13102024-12-20T21:11:53.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.174505911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
13112024-12-20T21:11:53.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 108.738795ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
13122024-12-20T21:11:53.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 509.347661ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
13132024-12-20T21:11:53.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 195.025738ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
13142024-12-20T21:11:53.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 1.168148792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
13152024-12-20T21:11:53.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 267.768425ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
13162024-12-20T21:11:53.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.045983718s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
13172024-12-20T21:11:53.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 773.366998ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
13182024-12-20T21:11:53.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 479.859831ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
13192024-12-20T21:11:53.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 1.277251973s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
13202024-12-20T21:11:53.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 929.419649ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
13212024-12-20T21:11:53.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 616.29656ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
13222024-12-20T21:11:54.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 554.642296ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
13232024-12-20T21:11:54.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 943.849401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
13242024-12-20T21:11:54.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 688.447736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
13252024-12-20T21:11:54.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 1.08364334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
13262024-12-20T21:11:54.503ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13272024-12-20T21:11:54.504ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
13282024-12-20T21:11:54.542ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13292024-12-20T21:11:54.543ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
13302024-12-20T21:11:54.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.094360521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
13312024-12-20T21:11:54.605ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='33cc7023-15d6-4fde-bf94-098f8a7fbab2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13322024-12-20T21:11:54.605ZINFOSledAgent (ServiceManager): Booting oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
13332024-12-20T21:11:54.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 886.244966ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
13342024-12-20T21:11:54.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 625.790991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
13352024-12-20T21:11:54.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 827.87632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
13362024-12-20T21:11:54.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 52.492541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
13372024-12-20T21:11:54.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 49.175761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
13382024-12-20T21:11:54.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 1.195015222s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
13392024-12-20T21:11:54.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 79.967557ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
13402024-12-20T21:11:54.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 108.876312ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
13412024-12-20T21:11:54.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.309501309s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
13422024-12-20T21:11:54.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 38.433262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
13432024-12-20T21:11:54.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 566.963712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
13442024-12-20T21:11:54.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 85.826931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
13452024-12-20T21:11:54.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 148.313656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
13462024-12-20T21:11:54.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 190.263108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
13472024-12-20T21:11:54.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 256.873827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
13482024-12-20T21:11:55.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 547.749191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
13492024-12-20T21:11:55.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 581.01239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
13502024-12-20T21:11:55.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 1.271252694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
13512024-12-20T21:11:55.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 1.119489784s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
13522024-12-20T21:11:55.197ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='f1085f8d-9892-4366-b54e-5e861c410b71'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13532024-12-20T21:11:55.198ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
13542024-12-20T21:11:55.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 571.773222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
13552024-12-20T21:11:55.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 322.360159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
13562024-12-20T21:11:55.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.198502564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
13572024-12-20T21:11:55.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 31.136165ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
13582024-12-20T21:11:55.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 884.418798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
13592024-12-20T21:11:55.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 144.541514ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
13602024-12-20T21:11:55.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 1.084152513s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
13612024-12-20T21:11:55.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 539.286926ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
13622024-12-20T21:11:55.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 938.344978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
13632024-12-20T21:11:55.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 1.279633443s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
13642024-12-20T21:11:55.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 250.14668ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
13652024-12-20T21:11:55.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 1.171083873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
13662024-12-20T21:11:55.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.400771431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
13672024-12-20T21:11:55.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 1.08358941s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
13682024-12-20T21:11:55.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 53.110339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
13692024-12-20T21:11:55.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 73.208745ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
13702024-12-20T21:11:55.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 1.053389273s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
13712024-12-20T21:11:55.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 112.768548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
13722024-12-20T21:11:55.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 87.35762ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
13732024-12-20T21:11:55.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 184.292197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
13742024-12-20T21:11:55.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 1.012013028s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
13752024-12-20T21:11:55.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 207.698293ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
13762024-12-20T21:11:56.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 184.435264ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
13772024-12-20T21:11:56.013ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13782024-12-20T21:11:56.013ZINFOSledAgent (ServiceManager): Booting oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
13792024-12-20T21:11:56.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 977.830273ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
13802024-12-20T21:11:56.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.170139286s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
13812024-12-20T21:11:56.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 377.662321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
13822024-12-20T21:11:56.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 564.063836ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
13832024-12-20T21:11:56.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 560.238395ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
13842024-12-20T21:11:56.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 62.417837ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
13852024-12-20T21:11:56.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 1.358062954s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
13862024-12-20T21:11:56.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 624.063401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
13872024-12-20T21:11:56.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 50.716549ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
13882024-12-20T21:11:56.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 112.210443ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
13892024-12-20T21:11:56.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 976.40436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
13902024-12-20T21:11:56.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.243125845s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
13912024-12-20T21:11:56.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 288.260956ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
13922024-12-20T21:11:56.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 807.532693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
13932024-12-20T21:11:56.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 789.612791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
13942024-12-20T21:11:56.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 585.885875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
13952024-12-20T21:11:56.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 724.136055ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
13962024-12-20T21:11:56.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 746.297852ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
13972024-12-20T21:11:56.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 812.759232ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
13982024-12-20T21:11:56.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 905.38584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
13992024-12-20T21:11:56.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 605.021226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
14002024-12-20T21:11:56.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 553.154443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
14012024-12-20T21:11:56.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 812.265626ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
14022024-12-20T21:11:56.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 1.0366169s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
14032024-12-20T21:11:57.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 1.449310122s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
14042024-12-20T21:11:57.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 1.323182627s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
14052024-12-20T21:11:57.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.189412224s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
14062024-12-20T21:11:57.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 1.144045116s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
14072024-12-20T21:11:57.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.425427607s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
14082024-12-20T21:11:57.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 940.664095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
14092024-12-20T21:11:57.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 1.35594676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
14102024-12-20T21:11:57.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 1.078501262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
14112024-12-20T21:11:57.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 807.597346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
14122024-12-20T21:11:57.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 513.076812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
14132024-12-20T21:11:57.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 1.234397814s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
14142024-12-20T21:11:57.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 1.218653523s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
14152024-12-20T21:11:57.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 1.167983018s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
14162024-12-20T21:11:57.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 522.836643ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
14172024-12-20T21:11:57.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.209884242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
14182024-12-20T21:11:57.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 1.162364854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
14192024-12-20T21:11:57.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 922.603359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
14202024-12-20T21:11:58.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 1.192913469s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
14212024-12-20T21:11:58.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 547.944507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
14222024-12-20T21:11:58.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 1.004982963s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
14232024-12-20T21:11:58.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 940.460295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
14242024-12-20T21:11:58.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 1.08731722s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
14252024-12-20T21:11:58.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.234346431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
14262024-12-20T21:11:58.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 1.464251266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
14272024-12-20T21:11:58.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 1.465490133s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
14282024-12-20T21:11:58.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 914.49978ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
14292024-12-20T21:11:58.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 982.278354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
14302024-12-20T21:11:58.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 923.53227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
14312024-12-20T21:11:58.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 856.665933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
14322024-12-20T21:11:58.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 1.333211679s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
14332024-12-20T21:11:58.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.235246001s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
14342024-12-20T21:11:58.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 1.131515725s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
14352024-12-20T21:11:58.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 522.013469ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
14362024-12-20T21:11:58.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 502.865636ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
14372024-12-20T21:11:58.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 1.419365013s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
14382024-12-20T21:11:58.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.353232078s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
14392024-12-20T21:11:59.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 710.253583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
14402024-12-20T21:11:59.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 1.044232392s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
14412024-12-20T21:11:59.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 995.176167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
14422024-12-20T21:11:59.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 1.096676776s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
14432024-12-20T21:11:59.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 583.123327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
14442024-12-20T21:11:59.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 1.289008239s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
14452024-12-20T21:11:59.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 1.273113024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
14462024-12-20T21:11:59.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 1.467332579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
14472024-12-20T21:11:59.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 1.493283554s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
14482024-12-20T21:11:59.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 940.301632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
14492024-12-20T21:11:59.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 524.330447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
14502024-12-20T21:11:59.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 984.278281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
14512024-12-20T21:11:59.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 1.30143291s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
14522024-12-20T21:11:59.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 923.794681ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
14532024-12-20T21:11:59.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 1.380332807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
14542024-12-20T21:11:59.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 847.875226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
14552024-12-20T21:12:00.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.104897861s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
14562024-12-20T21:12:00.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 659.988226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
14572024-12-20T21:12:00.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 616.537692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
14582024-12-20T21:12:00.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 1.162997629s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
14592024-12-20T21:12:00.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 612.668004ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
14602024-12-20T21:12:00.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.083748839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
14612024-12-20T21:12:00.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 1.03652021s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
14622024-12-20T21:12:00.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 723.186084ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
14632024-12-20T21:12:00.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 801.359483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
14642024-12-20T21:12:00.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 918.701423ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
14652024-12-20T21:12:00.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 850.28234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
14662024-12-20T21:12:00.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 1.489171482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
14672024-12-20T21:12:00.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 1.285623213s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
14682024-12-20T21:12:00.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 601.178605ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
14692024-12-20T21:12:00.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 1.442912827s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
14702024-12-20T21:12:00.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 533.729698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
14712024-12-20T21:12:00.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 820.418179ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
14722024-12-20T21:12:01.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 955.280132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
14732024-12-20T21:12:01.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 1.397418689s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
14742024-12-20T21:12:01.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.39643657s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
14752024-12-20T21:12:01.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 1.109851039s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
14762024-12-20T21:12:01.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 1.156815456s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
14772024-12-20T21:12:01.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 1.365128346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
14782024-12-20T21:12:01.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 1.450715563s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
14792024-12-20T21:12:01.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 701.742898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
14802024-12-20T21:12:01.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 1.045996509s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
14812024-12-20T21:12:01.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.366683122s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
14822024-12-20T21:12:01.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 1.312626146s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
14832024-12-20T21:12:01.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 505.48293ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
14842024-12-20T21:12:01.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 671.049079ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
14852024-12-20T21:12:01.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 1.196127844s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
14862024-12-20T21:12:01.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 903.193372ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
14872024-12-20T21:12:01.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 1.105552899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
14882024-12-20T21:12:02.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 1.370086722s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
14892024-12-20T21:12:02.107ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.316354779s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
14902024-12-20T21:12:02.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.048798086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
14912024-12-20T21:12:02.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 847.663072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
14922024-12-20T21:12:02.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 970.287747ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
14932024-12-20T21:12:02.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 946.954036ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
14942024-12-20T21:12:02.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 946.447448ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
14952024-12-20T21:12:02.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 637.453238ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
14962024-12-20T21:12:02.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 1.191803864s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
14972024-12-20T21:12:02.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 1.265797603s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
14982024-12-20T21:12:02.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 576.24261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
14992024-12-20T21:12:02.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 758.876968ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
15002024-12-20T21:12:02.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 1.354115623s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
15012024-12-20T21:12:02.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 1.348461277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
15022024-12-20T21:12:02.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 1.456414804s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
15032024-12-20T21:12:02.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.00271701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
15042024-12-20T21:12:02.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 1.496374799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
15052024-12-20T21:12:02.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 1.450467085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
15062024-12-20T21:12:03.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 1.175153228s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
15072024-12-20T21:12:03.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 1.296682724s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
15082024-12-20T21:12:03.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 874.008864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
15092024-12-20T21:12:03.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 804.48445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
15102024-12-20T21:12:03.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 899.103413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
15112024-12-20T21:12:03.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 1.454056827s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
15122024-12-20T21:12:03.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.208224491s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
15132024-12-20T21:12:03.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 1.305108385s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
15142024-12-20T21:12:03.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 639.258641ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
15152024-12-20T21:12:03.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 1.271473427s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
15162024-12-20T21:12:03.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 724.914476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
15172024-12-20T21:12:03.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 551.569546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
15182024-12-20T21:12:03.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 716.302997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
15192024-12-20T21:12:03.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 707.431509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
15202024-12-20T21:12:03.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 570.436163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
15212024-12-20T21:12:03.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 1.325550573s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
15222024-12-20T21:12:04.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 1.325682298s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
15232024-12-20T21:12:04.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 886.62366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
15242024-12-20T21:12:04.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.075248559s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
15252024-12-20T21:12:04.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 780.108383ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
15262024-12-20T21:12:04.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 673.359798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
15272024-12-20T21:12:04.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 963.917514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
15282024-12-20T21:12:04.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 1.358108096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
15292024-12-20T21:12:04.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 1.152203819s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
15302024-12-20T21:12:04.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 542.60638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
15312024-12-20T21:12:04.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 872.698356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
15322024-12-20T21:12:04.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.299727703s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
15332024-12-20T21:12:04.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 656.506807ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
15342024-12-20T21:12:04.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.463303136s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
15352024-12-20T21:12:04.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 807.886124ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
15362024-12-20T21:12:04.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 1.35888314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
15372024-12-20T21:12:04.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 1.183007864s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
15382024-12-20T21:12:04.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 879.725406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
15392024-12-20T21:12:04.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 625.131053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
15402024-12-20T21:12:04.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 1.257546762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
15412024-12-20T21:12:04.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 1.476297659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
15422024-12-20T21:12:05.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 1.247837382s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
15432024-12-20T21:12:05.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 878.725112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
15442024-12-20T21:12:05.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.493630501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
15452024-12-20T21:12:05.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 1.348182938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
15462024-12-20T21:12:05.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 912.756929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
15472024-12-20T21:12:05.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 551.980219ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
15482024-12-20T21:12:05.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 875.757327ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
15492024-12-20T21:12:05.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 1.064270959s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
15502024-12-20T21:12:05.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 1.057679545s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
15512024-12-20T21:12:05.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 694.219156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
15522024-12-20T21:12:05.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 1.276711756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
15532024-12-20T21:12:05.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 656.199656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
15542024-12-20T21:12:05.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 876.367138ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
15552024-12-20T21:12:05.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 1.232857615s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
15562024-12-20T21:12:05.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 702.916893ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
15572024-12-20T21:12:06.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 636.019058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
15582024-12-20T21:12:06.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.492185536s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
15592024-12-20T21:12:06.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 1.312193614s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
15602024-12-20T21:12:06.162ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15612024-12-20T21:12:06.162ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
15622024-12-20T21:12:06.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 500.266213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
15632024-12-20T21:12:06.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 775.980468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
15642024-12-20T21:12:06.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 876.559028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
15652024-12-20T21:12:06.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 1.277536695s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
15662024-12-20T21:12:06.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 815.533281ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
15672024-12-20T21:12:06.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 1.442575009s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
15682024-12-20T21:12:06.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 64.243924ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
15692024-12-20T21:12:06.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 149.293268ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
15702024-12-20T21:12:06.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 986.736854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
15712024-12-20T21:12:06.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 1.162191536s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
15722024-12-20T21:12:06.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 1.38342756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
15732024-12-20T21:12:06.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 139.141278ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
15742024-12-20T21:12:06.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 681.087864ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
15752024-12-20T21:12:06.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 1.196429148s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
15762024-12-20T21:12:06.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 607.478752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
15772024-12-20T21:12:06.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.03559131s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
15782024-12-20T21:12:06.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 501.904772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
15792024-12-20T21:12:06.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 663.01682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
15802024-12-20T21:12:06.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 306.322643ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
15812024-12-20T21:12:06.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 754.409554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
15822024-12-20T21:12:07.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 1.078218721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
15832024-12-20T21:12:07.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 420.020909ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
15842024-12-20T21:12:07.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 1.012122243s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
15852024-12-20T21:12:07.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 1.184199489s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
15862024-12-20T21:12:07.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 505.875374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
15872024-12-20T21:12:07.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 1.332930044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
15882024-12-20T21:12:07.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 883.304191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
15892024-12-20T21:12:07.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 682.726672ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
15902024-12-20T21:12:07.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.471100888s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
15912024-12-20T21:12:07.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 1.092594715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
15922024-12-20T21:12:07.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 817.557788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
15932024-12-20T21:12:07.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 590.686551ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
15942024-12-20T21:12:07.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 988.367753ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
15952024-12-20T21:12:07.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 648.706345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
15962024-12-20T21:12:07.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 898.551191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
15972024-12-20T21:12:07.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 853.638938ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
15982024-12-20T21:12:07.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 825.007914ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
15992024-12-20T21:12:07.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.118669836s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
16002024-12-20T21:12:07.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 1.230801785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
16012024-12-20T21:12:07.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 1.309179997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
16022024-12-20T21:12:07.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 583.536955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
16032024-12-20T21:12:08.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 1.459718772s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
16042024-12-20T21:12:08.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 1.270849595s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
16052024-12-20T21:12:08.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 1.348327928s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
16062024-12-20T21:12:08.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 872.113177ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
16072024-12-20T21:12:08.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 513.515321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
16082024-12-20T21:12:08.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.265090157s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
16092024-12-20T21:12:08.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 1.168751683s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
16102024-12-20T21:12:08.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 1.284452483s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
16112024-12-20T21:12:08.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 1.340104907s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
16122024-12-20T21:12:08.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 683.633462ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
16132024-12-20T21:12:08.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 689.035702ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
16142024-12-20T21:12:08.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 1.348304327s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
16152024-12-20T21:12:08.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 651.594704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
16162024-12-20T21:12:08.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 711.005492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
16172024-12-20T21:12:08.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 1.04286284s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
16182024-12-20T21:12:08.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 1.43780662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
16192024-12-20T21:12:08.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.112548969s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
16202024-12-20T21:12:08.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 520.944687ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
16212024-12-20T21:12:09.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 1.239450523s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
16222024-12-20T21:12:09.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 1.085700328s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
16232024-12-20T21:12:09.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 1.026958591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
16242024-12-20T21:12:09.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 983.965183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
16252024-12-20T21:12:09.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 1.240820774s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
16262024-12-20T21:12:09.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 1.046693527s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
16272024-12-20T21:12:09.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 579.123335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
16282024-12-20T21:12:09.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 1.490012702s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
16292024-12-20T21:12:09.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 643.435047ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
16302024-12-20T21:12:09.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 1.334054307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
16312024-12-20T21:12:09.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 626.153126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
16322024-12-20T21:12:09.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 1.285090062s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
16332024-12-20T21:12:09.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.223245324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
16342024-12-20T21:12:09.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 1.27595954s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
16352024-12-20T21:12:09.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 1.350663211s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
16362024-12-20T21:12:09.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 654.274209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
16372024-12-20T21:12:09.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 901.689958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
16382024-12-20T21:12:09.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 1.214908s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
16392024-12-20T21:12:10.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 678.845596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
16402024-12-20T21:12:10.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.038122858s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
16412024-12-20T21:12:10.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 551.443182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
16422024-12-20T21:12:10.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 754.050543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
16432024-12-20T21:12:10.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 1.098337089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
16442024-12-20T21:12:10.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 996.626966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
16452024-12-20T21:12:10.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 641.773692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
16462024-12-20T21:12:10.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 849.948479ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
16472024-12-20T21:12:10.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 1.20607218s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
16482024-12-20T21:12:10.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 672.727362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
16492024-12-20T21:12:10.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 1.306608085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
16502024-12-20T21:12:10.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 1.181837106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
16512024-12-20T21:12:10.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 770.300978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
16522024-12-20T21:12:10.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 821.573735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
16532024-12-20T21:12:10.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 1.064871608s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
16542024-12-20T21:12:10.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 917.017625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
16552024-12-20T21:12:10.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 663.601568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
16562024-12-20T21:12:10.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 751.626706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
16572024-12-20T21:12:10.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 1.280749925s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
16582024-12-20T21:12:10.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 1.234311275s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
16592024-12-20T21:12:10.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 944.382672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
16602024-12-20T21:12:11.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 589.005346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
16612024-12-20T21:12:11.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369") failed: Property not found. retry in 1.359551112s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
16622024-12-20T21:12:11.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 1.027918856s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
16632024-12-20T21:12:11.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 639.969048ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
16642024-12-20T21:12:11.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 740.888075ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
16652024-12-20T21:12:11.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 570.507149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
16662024-12-20T21:12:11.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 856.573618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
16672024-12-20T21:12:11.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0") failed: Property not found. retry in 1.392772086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
16682024-12-20T21:12:11.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 582.69433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
16692024-12-20T21:12:11.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 765.706693ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
16702024-12-20T21:12:11.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89") failed: Property not found. retry in 1.379461233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
16712024-12-20T21:12:11.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e") failed: Property not found. retry in 1.188086016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
16722024-12-20T21:12:11.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 1.40100647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
16732024-12-20T21:12:11.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 743.792053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
16742024-12-20T21:12:11.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 1.07970062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
16752024-12-20T21:12:11.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 1.251410844s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
16762024-12-20T21:12:11.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4") failed: Property not found. retry in 1.045270528s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
16772024-12-20T21:12:11.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 571.943366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
16782024-12-20T21:12:11.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 1.44982952s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
16792024-12-20T21:12:11.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f") failed: Property not found. retry in 1.204551812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
16802024-12-20T21:12:11.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac") failed: Property not found. retry in 1.309068775s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
16812024-12-20T21:12:12.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc") failed: Property not found. retry in 826.651347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
16822024-12-20T21:12:12.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa") failed: Property not found. retry in 661.389705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
16832024-12-20T21:12:12.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 678.613208ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
16842024-12-20T21:12:12.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481") failed: Property not found. retry in 940.146537ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
16852024-12-20T21:12:12.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 525.053138ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
16862024-12-20T21:12:12.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497") failed: Property not found. retry in 540.55428ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
16872024-12-20T21:12:12.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4") failed: Property not found. retry in 1.391368311s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
16882024-12-20T21:12:12.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 560.553785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
16892024-12-20T21:12:12.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 513.588933ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
16902024-12-20T21:12:12.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 979.326372ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
16912024-12-20T21:12:12.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b") failed: Property not found. retry in 1.338370771s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
16922024-12-20T21:12:13.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4") failed: Property not found. retry in 800.183339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
16932024-12-20T21:12:13.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276") failed: Property not found. retry in 957.262702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
16942024-12-20T21:12:13.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2") failed: Property not found. retry in 511.590754ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
16952024-12-20T21:12:13.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35") failed: Property not found. retry in 792.355447ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
16962024-12-20T21:12:13.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71") failed: Property not found. retry in 865.443745ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
16972024-12-20T21:12:13.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 1.165322671s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
16982024-12-20T21:12:15.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 848.344228ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
16992024-12-20T21:12:15.774ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59201
17002024-12-20T21:12:15.780ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59201 req_id = 113fe39b-33ef-4641-aa10-983c56649cd7 response_code = 200 uri = /baseboard
17012024-12-20T21:12:15.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 610.717162ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
17022024-12-20T21:12:16.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 1.064922311s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
17032024-12-20T21:12:17.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 1.171373271s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
17042024-12-20T21:12:18.465ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.52588753s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
17052024-12-20T21:12:18.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f") failed: Property not found. retry in 1.070647577s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
17062024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_f63aaed9-c1ac-4da1-8ea8-97657d726276
17072024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_ad8ba988-04b3-431c-9de9-181f31cefa9f
17082024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_3f3c284d-f6ea-4c08-b99f-d3400a604b35
17092024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_d76d6b77-e70a-49c4-bea4-f8de37be62aa
17102024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_00388d64-9eba-4119-a557-78f9dac1d369
17112024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_33a5393a-715c-43fb-8918-ce2bd8ffd497
17122024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_2ce89eef-7010-4d0d-91b1-35192322c0ac
17132024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_42e0a324-3b38-4eb7-a588-ce1de2417f9b
17142024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_372e8326-6f47-4ce6-a4f2-8c6ec76aa4e4
17152024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_137427fe-5d65-4543-802c-a51a414d705e
17162024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_146c78a1-4090-415b-a726-0fab63981481
17172024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_51a04160-e997-4230-9ab3-89d07898a9e0
17182024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_63f7887d-76c9-468f-a0a3-27dfe82d1cb4
17192024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_f1085f8d-9892-4366-b54e-5e861c410b71
17202024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_75b5a577-2bb7-4181-95b9-c53983e5bbbc
17212024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_370be31d-7959-481f-8868-85802c25d2e4
17222024-12-20T21:12:19.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_86716406-3842-4388-afaa-f7683f7c950f
17232024-12-20T21:12:19.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_67b5dc40-b3bd-4c7c-8633-7b3021d837d2
17242024-12-20T21:12:19.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_f8384d9e-d33e-4c2e-a1d2-93392d74ac89
17252024-12-20T21:12:19.889ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17262024-12-20T21:12:19.890ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17272024-12-20T21:12:19.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34151299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42629 req_id = f42af82c-e776-41d7-b222-1e43c1dfbbd4 response_code = 204 uri = /omicron-zones
17282024-12-20T21:12:19.907ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17292024-12-20T21:12:19.916ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17302024-12-20T21:12:19.920ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
17312024-12-20T21:12:19.956ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
17322024-12-20T21:12:19.966ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17332024-12-20T21:12:20.041ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17342024-12-20T21:12:20.164ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17352024-12-20T21:12:20.243ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17362024-12-20T21:12:20.462ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17372024-12-20T21:12:20.670ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17382024-12-20T21:12:20.883ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17392024-12-20T21:12:21.023ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.273992019s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
17402024-12-20T21:12:21.100ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17412024-12-20T21:12:21.367ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17422024-12-20T21:12:21.604ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17432024-12-20T21:12:22.174ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/19e96990-2b5d-4cc7-a5f5-981b28881f94/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17442024-12-20T21:12:23.057ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "84372dc0-3811-41a2-9da4-d91c594d10fe", "content-length": "113", "date": "Fri, 20 Dec 2024 21:12:22 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "84372dc0-3811-41a2-9da4-d91c594d10fe" } file = sled-agent/src/rack_setup/service.rs:1078
17452024-12-20T21:12:24.716ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6a058516-3229-40eb-8d5c-77b3953d1af3", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:24 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"19e96990-2b5d-4cc7-a5f5-981b28881f94\"", request_id: "6a058516-3229-40eb-8d5c-77b3953d1af3" } file = sled-agent/src/rack_setup/service.rs:1078
17462024-12-20T21:12:25.281ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d2638477-2bdb-48ea-b511-58d1df976f61", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"19e96990-2b5d-4cc7-a5f5-981b28881f94\"", request_id: "d2638477-2bdb-48ea-b511-58d1df976f61" } file = sled-agent/src/rack_setup/service.rs:1078
17472024-12-20T21:12:27.680ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9c3b3e7d-cb5a-4eb8-bf77-d743f5205624", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9ab49b39-4891-4f63-9152-18cfc9c75d04\"", request_id: "9c3b3e7d-cb5a-4eb8-bf77-d743f5205624" } file = sled-agent/src/rack_setup/service.rs:1078
17482024-12-20T21:12:29.613ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2f3be254-adf4-4199-9aaa-9d05cd7a0e4a", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9ab49b39-4891-4f63-9152-18cfc9c75d04\"", request_id: "2f3be254-adf4-4199-9aaa-9d05cd7a0e4a" } file = sled-agent/src/rack_setup/service.rs:1078
17492024-12-20T21:12:32.328ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c5f8dd56-5888-432b-bd84-9aa9940fc1cb", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:32 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9ab49b39-4891-4f63-9152-18cfc9c75d04\"", request_id: "c5f8dd56-5888-432b-bd84-9aa9940fc1cb" } file = sled-agent/src/rack_setup/service.rs:1078
17502024-12-20T21:12:34.564ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c279a468-5e7e-475a-bfc6-fd10ad2e0f35", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:34 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9ab49b39-4891-4f63-9152-18cfc9c75d04\"", request_id: "c279a468-5e7e-475a-bfc6-fd10ad2e0f35" } file = sled-agent/src/rack_setup/service.rs:1078
17512024-12-20T21:12:36.707ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f47af30d-b46d-4ff5-90aa-aabaf69bb05d", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9ab49b39-4891-4f63-9152-18cfc9c75d04\"", request_id: "f47af30d-b46d-4ff5-90aa-aabaf69bb05d" } file = sled-agent/src/rack_setup/service.rs:1078
17522024-12-20T21:12:38.752ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "90e32684-97f5-44df-97ad-d01a794400f5", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9ab49b39-4891-4f63-9152-18cfc9c75d04\"", request_id: "90e32684-97f5-44df-97ad-d01a794400f5" } file = sled-agent/src/rack_setup/service.rs:1078
17532024-12-20T21:12:41.186ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "dcf60a10-1126-4316-98bc-3dfabb72c187", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9ab49b39-4891-4f63-9152-18cfc9c75d04\"", request_id: "dcf60a10-1126-4316-98bc-3dfabb72c187" } file = sled-agent/src/rack_setup/service.rs:1078
17542024-12-20T21:12:45.494ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e3d55c58-2219-4633-a341-0ad76f642a9e", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9ab49b39-4891-4f63-9152-18cfc9c75d04\"", request_id: "e3d55c58-2219-4633-a341-0ad76f642a9e" } file = sled-agent/src/rack_setup/service.rs:1078
17552024-12-20T21:12:45.817ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34736
17562024-12-20T21:12:45.818ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34736 req_id = eca93fa0-dd26-47c3-9d0a-2357f3fa0886 response_code = 200 uri = /baseboard
17572024-12-20T21:12:51.696ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "12d69712-1093-4d37-8634-0b797265c4f7", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9ab49b39-4891-4f63-9152-18cfc9c75d04\"", request_id: "12d69712-1093-4d37-8634-0b797265c4f7" } file = sled-agent/src/rack_setup/service.rs:1078
17582024-12-20T21:12:54.922ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "091562c9-57cb-44dd-bb32-65a31f7db5da", "content-length": "173", "date": "Fri, 20 Dec 2024 21:12:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9ab49b39-4891-4f63-9152-18cfc9c75d04\"", request_id: "091562c9-57cb-44dd-bb32-65a31f7db5da" } file = sled-agent/src/rack_setup/service.rs:1078
17592024-12-20T21:12:55.884ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
17602024-12-20T21:12:55.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40357
17612024-12-20T21:12:55.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17622024-12-20T21:12:55.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17632024-12-20T21:12:55.992ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-zones.json file = common/src/ledger.rs:177
17642024-12-20T21:12:55.992ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-zones.json file = common/src/ledger.rs:177
17652024-12-20T21:12:56.004ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17662024-12-20T21:12:56.004ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6cbb0b58-4d44-45b0-895e-d80165779045
17672024-12-20T21:12:56.032ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17682024-12-20T21:12:56.032ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8
17692024-12-20T21:12:56.055ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17702024-12-20T21:12:56.055ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_70bee423-c23a-4941-9c18-69f4feca1839
17712024-12-20T21:12:56.078ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17722024-12-20T21:12:56.078ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d53f565a-e812-4053-98b4-59c34d29e75c
17732024-12-20T21:12:56.100ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17742024-12-20T21:12:56.100ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75
17752024-12-20T21:12:56.122ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17762024-12-20T21:12:56.122ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4d0b1b25-4a74-46a6-945f-18014df947c1
17772024-12-20T21:12:56.142ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17782024-12-20T21:12:56.142ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2
17792024-12-20T21:12:56.163ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17802024-12-20T21:12:56.163ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94
17812024-12-20T21:12:56.184ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17822024-12-20T21:12:56.184ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e
17832024-12-20T21:12:56.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206473 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40357 req_id = 171759e1-40da-4253-9f6e-af420a21675d response_code = 200 uri = /inventory
17842024-12-20T21:12:56.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33905
17852024-12-20T21:12:56.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1046 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33905 req_id = 6adfaacf-8132-4ce7-9bf2-dcbafa31d8f6 response_code = 200 uri = /vpc-routes
17862024-12-20T21:12:56.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
17872024-12-20T21:12:56.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33905 req_id = 3f1816ef-9d36-4cfc-a6e1-7d7ae7f277a8 response_code = 204 uri = /eip-gateways
17882024-12-20T21:12:56.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36064
17892024-12-20T21:12:56.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1045 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36064 req_id = cb085f45-f166-4062-9c5e-d953e5f65814 response_code = 200 uri = /v2p
17902024-12-20T21:12:56.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3612 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33905 req_id = a9398365-e3eb-4132-be8b-9222658d7fbf response_code = 204 uri = /vpc-routes
17912024-12-20T21:12:56.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52063
17922024-12-20T21:12:56.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52063 req_id = 32cf245d-1979-4903-bda7-e4375dc3d072 response_code = 200 uri = /vpc-routes
17932024-12-20T21:12:56.798ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
17942024-12-20T21:12:56.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52063 req_id = 513c17a2-059c-4e0e-bb91-7ca9826a0742 response_code = 204 uri = /eip-gateways
17952024-12-20T21:12:56.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52063 req_id = e66c01bb-5b28-4fae-ba4c-3a165b804b07 response_code = 204 uri = /vpc-routes
17962024-12-20T21:12:56.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60221
17972024-12-20T21:12:56.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60221 req_id = e9dd2cc5-1704-4e0d-bcea-ae63bb8c7020 response_code = 200 uri = /v2p
17982024-12-20T21:13:02.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36067
17992024-12-20T21:13:02.208ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18002024-12-20T21:13:02.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18012024-12-20T21:13:02.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18022024-12-20T21:13:02.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18032024-12-20T21:13:02.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18042024-12-20T21:13:02.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18052024-12-20T21:13:02.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18062024-12-20T21:13:02.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1875 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36067 req_id = 26879bdb-21e9-4a69-ad2c-2640da89f981 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18072024-12-20T21:13:02.210ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
18082024-12-20T21:13:02.213ZINFOSledAgent (RSS): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18092024-12-20T21:13:02.213ZINFOSledAgent (RSS): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18102024-12-20T21:13:02.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57528
18112024-12-20T21:13:02.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18122024-12-20T21:13:02.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18132024-12-20T21:13:02.565ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-zones.json file = common/src/ledger.rs:177
18142024-12-20T21:13:02.566ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-zones.json file = common/src/ledger.rs:177
18152024-12-20T21:13:02.578ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18162024-12-20T21:13:02.578ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6cbb0b58-4d44-45b0-895e-d80165779045
18172024-12-20T21:13:02.607ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18182024-12-20T21:13:02.607ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8
18192024-12-20T21:13:02.630ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18202024-12-20T21:13:02.630ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_70bee423-c23a-4941-9c18-69f4feca1839
18212024-12-20T21:13:02.651ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18222024-12-20T21:13:02.651ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d53f565a-e812-4053-98b4-59c34d29e75c
18232024-12-20T21:13:02.671ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18242024-12-20T21:13:02.671ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75
18252024-12-20T21:13:02.690ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18262024-12-20T21:13:02.691ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4d0b1b25-4a74-46a6-945f-18014df947c1
18272024-12-20T21:13:02.711ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18282024-12-20T21:13:02.711ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2
18292024-12-20T21:13:02.730ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18302024-12-20T21:13:02.730ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94
18312024-12-20T21:13:02.750ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18322024-12-20T21:13:02.750ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e
18332024-12-20T21:13:02.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195644 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57528 req_id = 58ab537b-b3e8-421c-a71c-8aa84a210e4e response_code = 200 uri = /inventory
18342024-12-20T21:13:02.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51747
18352024-12-20T21:13:02.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51747 req_id = d39a353d-f8cd-47a7-bb4a-1e9976ebe19c response_code = 200 uri = /vpc-routes
18362024-12-20T21:13:02.834ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
18372024-12-20T21:13:02.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51747 req_id = ea8dd2da-2277-4129-add0-99fc7adcb49b response_code = 204 uri = /eip-gateways
18382024-12-20T21:13:02.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51747 req_id = 247563bd-e865-47b5-88b1-69672b289069 response_code = 204 uri = /vpc-routes
18392024-12-20T21:13:02.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35335
18402024-12-20T21:13:02.996ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18412024-12-20T21:13:03.084ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18422024-12-20T21:13:03.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164034 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35335 req_id = 4502dfde-c678-4c79-901e-dcb0ecb30515 response_code = 204 uri = /switch-ports
18432024-12-20T21:13:03.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52808
18442024-12-20T21:13:03.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52808 req_id = 417f1f3c-495f-4698-ae9c-5f0ac2a411c9 response_code = 200 uri = /v2p
18452024-12-20T21:13:03.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35335 req_id = f44c5da5-a204-4a11-a1b4-7fa329477229 response_code = 200 uri = /network-bootstore-config
18462024-12-20T21:13:03.220ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18472024-12-20T21:13:03.220ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18482024-12-20T21:13:03.221ZINFOSledAgent (bootstore): Writing ledger to /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18492024-12-20T21:13:03.222ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18502024-12-20T21:13:03.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2724 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35335 req_id = 737a8a55-632a-4cd6-8bd3-40f109bb5af4 response_code = 204 uri = /network-bootstore-config
18512024-12-20T21:13:03.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43873
18522024-12-20T21:13:03.291ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18532024-12-20T21:13:03.291ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18542024-12-20T21:13:03.291ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18552024-12-20T21:13:03.291ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18562024-12-20T21:13:03.291ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18572024-12-20T21:13:03.291ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18582024-12-20T21:13:03.291ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18592024-12-20T21:13:03.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43873 req_id = 44a82ed1-7ce9-4011-95ae-301ddab4f51d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18602024-12-20T21:13:04.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37401
18612024-12-20T21:13:04.188ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18622024-12-20T21:13:04.188ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18632024-12-20T21:13:04.188ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18642024-12-20T21:13:04.189ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18652024-12-20T21:13:04.189ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18662024-12-20T21:13:04.189ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18672024-12-20T21:13:04.189ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18682024-12-20T21:13:04.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37401 req_id = ce52e4c9-3fc4-438b-99e8-4981836cb440 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18692024-12-20T21:13:04.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56279
18702024-12-20T21:13:04.226ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18712024-12-20T21:13:04.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18722024-12-20T21:13:04.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18732024-12-20T21:13:04.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18742024-12-20T21:13:04.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18752024-12-20T21:13:04.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18762024-12-20T21:13:04.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18772024-12-20T21:13:04.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56279 req_id = 1ad2ba59-78e4-47d3-a47c-eec32f89e547 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18782024-12-20T21:13:07.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61532
18792024-12-20T21:13:07.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61532 req_id = 7a808fe6-bee6-4bb6-bb69-332af719cf59 response_code = 200 uri = /vpc-routes
18802024-12-20T21:13:07.794ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
18812024-12-20T21:13:07.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61532 req_id = 969ef0d5-5bb9-4c54-89b7-4413153fb5c5 response_code = 204 uri = /eip-gateways
18822024-12-20T21:13:07.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61532 req_id = 19df3c18-eb0f-4ab4-83db-42979c826b38 response_code = 204 uri = /vpc-routes
18832024-12-20T21:13:09.111ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:64338 remote_addr = [fd00:1122:3344:101::d]:49038 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
18842024-12-20T21:13:09.140ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28721 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 8dfc8759-bf7c-412a-badb-30cc9a29590d response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
18852024-12-20T21:13:15.851ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64723
18862024-12-20T21:13:15.851ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64723 req_id = 09495e6c-39f0-4d26-9b24-5dd51c6382bf response_code = 200 uri = /baseboard
18872024-12-20T21:13:26.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54875
18882024-12-20T21:13:26.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54875 req_id = 942b2faa-40f4-4d6a-8604-79c090af9372 response_code = 200 uri = /vpc-routes
18892024-12-20T21:13:26.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56394
18902024-12-20T21:13:26.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56394 req_id = b13e5327-2a43-404a-83a4-f4b249913a96 response_code = 200 uri = /v2p
18912024-12-20T21:13:26.783ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
18922024-12-20T21:13:26.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54875 req_id = 0d26215d-d136-4307-8164-ea57771fdd39 response_code = 204 uri = /eip-gateways
18932024-12-20T21:13:26.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54875 req_id = f2ff8040-c3b3-46b0-883e-a6f16618ae7c response_code = 204 uri = /vpc-routes
18942024-12-20T21:13:26.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60719
18952024-12-20T21:13:26.871ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18962024-12-20T21:13:26.912ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18972024-12-20T21:13:26.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60719 req_id = 46f5c82c-43b6-49ca-b9aa-88a0f6f7a329 response_code = 204 uri = /switch-ports
18982024-12-20T21:13:26.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59303
18992024-12-20T21:13:26.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59303 req_id = 48154edb-1eb7-48ce-abc0-10ae411343b5 response_code = 200 uri = /vpc-routes
19002024-12-20T21:13:26.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60719 req_id = 4e56771e-bc94-42b7-9208-c223792f4ff4 response_code = 200 uri = /network-bootstore-config
19012024-12-20T21:13:27.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58204
19022024-12-20T21:13:27.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58204 req_id = a16860ce-3e97-4b49-8756-e2bdd3508bac response_code = 200 uri = /v2p
19032024-12-20T21:13:27.122ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
19042024-12-20T21:13:27.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59303 req_id = 792afadf-70a6-4964-a0d7-bdcbd5d8aac2 response_code = 204 uri = /eip-gateways
19052024-12-20T21:13:27.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59303 req_id = 3e26dfae-cb14-4e12-926c-05a3148b4cf1 response_code = 204 uri = /vpc-routes
19062024-12-20T21:13:27.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52206
19072024-12-20T21:13:27.213ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19082024-12-20T21:13:27.249ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19092024-12-20T21:13:27.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88397 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52206 req_id = 783cd732-7fa6-43ff-8a06-c7b14de39b7d response_code = 204 uri = /switch-ports
19102024-12-20T21:13:27.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52206 req_id = 567bed47-11b6-449c-8b11-ed09057f0041 response_code = 200 uri = /network-bootstore-config
19112024-12-20T21:13:32.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38738
19122024-12-20T21:13:32.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38738 req_id = a92fd5d4-b5ab-4b39-b986-568d73902ef2 response_code = 200 uri = /vpc-routes
19132024-12-20T21:13:32.907ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
19142024-12-20T21:13:32.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38738 req_id = cd69ebe1-11b0-486e-896e-343649fc8000 response_code = 204 uri = /eip-gateways
19152024-12-20T21:13:32.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50728
19162024-12-20T21:13:32.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50728 req_id = aa228990-1644-4af8-9dae-55223a2edfb2 response_code = 200 uri = /v2p
19172024-12-20T21:13:32.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38738 req_id = 04041bab-e271-4719-964b-6bb8469f6088 response_code = 204 uri = /vpc-routes
19182024-12-20T21:13:33.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63407
19192024-12-20T21:13:33.247ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19202024-12-20T21:13:33.282ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19212024-12-20T21:13:33.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93395 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63407 req_id = 25371a4e-eee1-4ba8-8255-9f8223eaee63 response_code = 204 uri = /switch-ports
19222024-12-20T21:13:33.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 736 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63407 req_id = 937b34e6-798c-4a86-b74e-04822b8c5514 response_code = 200 uri = /network-bootstore-config
19232024-12-20T21:13:39.119ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6705 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 36c9c1da-552b-49a8-a8ad-b314f4083c66 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
19242024-12-20T21:13:45.903ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59295
19252024-12-20T21:13:45.904ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59295 req_id = 0c799589-f6f8-41c0-8c4f-b6a99207ee79 response_code = 200 uri = /baseboard
19262024-12-20T21:13:56.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55017
19272024-12-20T21:13:56.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55017 req_id = 19f683ba-3f87-47e7-a04e-1e7c34948b63 response_code = 200 uri = /vpc-routes
19282024-12-20T21:13:56.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45830
19292024-12-20T21:13:56.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45830 req_id = 92d2ee55-0edc-41d6-abf5-c386f610d394 response_code = 200 uri = /v2p
19302024-12-20T21:13:56.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
19312024-12-20T21:13:56.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55017 req_id = 441a1fc9-fbe2-484a-98d6-fc3ef562d21a response_code = 204 uri = /eip-gateways
19322024-12-20T21:13:56.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55017 req_id = 5b424608-09e0-4865-a5b6-5d0608504b17 response_code = 204 uri = /vpc-routes
19332024-12-20T21:13:56.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58377
19342024-12-20T21:13:56.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19352024-12-20T21:13:56.878ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19362024-12-20T21:13:56.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93889 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58377 req_id = 1e79e9e9-9e79-42f9-83b0-f0a9ad18442e response_code = 204 uri = /switch-ports
19372024-12-20T21:13:56.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56085
19382024-12-20T21:13:56.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58377 req_id = 244b2dd4-ddc6-48d5-9271-06bc768d2637 response_code = 200 uri = /network-bootstore-config
19392024-12-20T21:13:56.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56085 req_id = 81e922d2-d7a2-4c4d-a307-2f28fff8536b response_code = 200 uri = /vpc-routes
19402024-12-20T21:13:56.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
19412024-12-20T21:13:56.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56085 req_id = c1820dfb-1ccd-46e4-977d-feda00a8b62d response_code = 204 uri = /eip-gateways
19422024-12-20T21:13:56.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56085 req_id = 7cf2d3f9-508f-46cc-bd0b-f0a43d12ae57 response_code = 204 uri = /vpc-routes
19432024-12-20T21:13:57.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59428
19442024-12-20T21:13:57.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59428 req_id = 893442a9-6807-4edc-9097-56da207f8efd response_code = 200 uri = /v2p
19452024-12-20T21:13:57.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65400
19462024-12-20T21:13:57.273ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19472024-12-20T21:13:57.312ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19482024-12-20T21:13:57.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65400 req_id = 946a2d2b-bf73-4106-bcb6-764c815241e6 response_code = 204 uri = /switch-ports
19492024-12-20T21:13:57.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65400 req_id = 7ce46a64-1eff-434d-ac49-46306583d73e response_code = 200 uri = /network-bootstore-config
19502024-12-20T21:14:02.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53279
19512024-12-20T21:14:02.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53279 req_id = 5e48000a-adad-4a23-a421-e9e0edaaba10 response_code = 200 uri = /vpc-routes
19522024-12-20T21:14:02.690ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
19532024-12-20T21:14:02.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53279 req_id = fd401d2a-7eb9-4edb-abc3-947b43cab194 response_code = 204 uri = /eip-gateways
19542024-12-20T21:14:02.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53279 req_id = e17a3aca-f0a0-42ae-9153-0574a97c2f6b response_code = 204 uri = /vpc-routes
19552024-12-20T21:14:02.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59197
19562024-12-20T21:14:02.713ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19572024-12-20T21:14:02.752ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19582024-12-20T21:14:02.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93053 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59197 req_id = e7611fa1-2a37-42a3-be1d-87bbd995b08a response_code = 204 uri = /switch-ports
19592024-12-20T21:14:02.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62861
19602024-12-20T21:14:02.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62861 req_id = f3d37ad2-d18a-4cb7-8020-336871413b01 response_code = 200 uri = /v2p
19612024-12-20T21:14:02.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59197 req_id = 5fa649ec-eb12-4943-a3cf-265b49f1f47a response_code = 200 uri = /network-bootstore-config
19622024-12-20T21:14:09.117ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7105 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = f4a38eaa-0a8d-4853-a72e-d603054dbac2 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
19632024-12-20T21:14:15.936ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65320
19642024-12-20T21:14:15.936ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65320 req_id = e5043ae4-fc02-43ff-96a0-10434f83647f response_code = 200 uri = /baseboard
19652024-12-20T21:14:26.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51101
19662024-12-20T21:14:26.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51101 req_id = 89a09ed4-ba29-47eb-b65a-ccb3e3e4575b response_code = 200 uri = /vpc-routes
19672024-12-20T21:14:26.686ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
19682024-12-20T21:14:26.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51101 req_id = dacf5b3f-6f85-4463-b806-b10dfc03d3d5 response_code = 204 uri = /eip-gateways
19692024-12-20T21:14:26.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51101 req_id = 27400dc3-c094-4f92-8cf9-314e3462f862 response_code = 204 uri = /vpc-routes
19702024-12-20T21:14:26.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43945
19712024-12-20T21:14:26.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43945 req_id = 2112bc3d-e7c7-47c3-99df-45048bd2059d response_code = 200 uri = /v2p
19722024-12-20T21:14:26.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51741
19732024-12-20T21:14:26.921ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19742024-12-20T21:14:26.961ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19752024-12-20T21:14:27.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51741 req_id = 02c30e9e-609f-4821-b26e-358146d5cd74 response_code = 204 uri = /switch-ports
19762024-12-20T21:14:27.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51741 req_id = db109e14-935d-4da9-9fd2-ee75af889665 response_code = 200 uri = /network-bootstore-config
19772024-12-20T21:14:27.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57125
19782024-12-20T21:14:27.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57125 req_id = 3f186b86-7779-4d69-b769-a2882e3425c4 response_code = 200 uri = /vpc-routes
19792024-12-20T21:14:27.111ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
19802024-12-20T21:14:27.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57125 req_id = f386e5a6-92ef-484d-a8a3-247d6dc87f8e response_code = 204 uri = /eip-gateways
19812024-12-20T21:14:27.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57125 req_id = 659e4cc7-8960-464d-900b-a76f38e35341 response_code = 204 uri = /vpc-routes
19822024-12-20T21:14:27.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45156
19832024-12-20T21:14:27.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45156 req_id = 9f5daab9-0f72-4786-b389-184f5e227264 response_code = 200 uri = /v2p
19842024-12-20T21:14:27.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45816
19852024-12-20T21:14:27.228ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19862024-12-20T21:14:27.264ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19872024-12-20T21:14:27.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86669 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45816 req_id = a70cf75d-2dc1-4793-a1c3-8e9a0bcde511 response_code = 204 uri = /switch-ports
19882024-12-20T21:14:27.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45816 req_id = ba7aa898-3b80-4278-a1d9-2fe640684cce response_code = 200 uri = /network-bootstore-config
19892024-12-20T21:14:32.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57989
19902024-12-20T21:14:32.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57989 req_id = d027fa41-2213-41d0-91de-8e3c4d433fc3 response_code = 200 uri = /vpc-routes
19912024-12-20T21:14:32.923ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
19922024-12-20T21:14:32.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57989 req_id = 0b8a1fbd-ee23-47ce-861d-4b176ca60234 response_code = 204 uri = /eip-gateways
19932024-12-20T21:14:32.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57989 req_id = 5c76d862-3224-430b-a671-04fde64db30a response_code = 204 uri = /vpc-routes
19942024-12-20T21:14:32.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49933
19952024-12-20T21:14:32.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49933 req_id = f9f83ed7-9cb4-48c8-9e8f-f7e4cf2a0b98 response_code = 200 uri = /v2p
19962024-12-20T21:14:32.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62066
19972024-12-20T21:14:32.980ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19982024-12-20T21:14:33.031ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19992024-12-20T21:14:33.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105610 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62066 req_id = f4ea457e-a397-4c18-9476-15860dc458b8 response_code = 204 uri = /switch-ports
20002024-12-20T21:14:33.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62066 req_id = 4b6394a0-2acc-420e-bb97-2a3bf24b8e90 response_code = 200 uri = /network-bootstore-config
20012024-12-20T21:14:39.116ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7063 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 42453154-623c-43b8-911a-5cae2901c482 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
20022024-12-20T21:14:45.969ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62941
20032024-12-20T21:14:45.969ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62941 req_id = f7ea081f-906b-48fc-ab62-ccd58a9bad6d response_code = 200 uri = /baseboard
20042024-12-20T21:14:56.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58495
20052024-12-20T21:14:56.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58495 req_id = 996d8eef-3785-4a98-9319-85bc32c0cc82 response_code = 200 uri = /vpc-routes
20062024-12-20T21:14:56.535ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
20072024-12-20T21:14:56.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58495 req_id = 03a64f63-b31e-4d1b-a436-602c2b16901f response_code = 204 uri = /eip-gateways
20082024-12-20T21:14:56.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58495 req_id = 0842e43c-eb17-4537-b5b0-90a397a82fee response_code = 204 uri = /vpc-routes
20092024-12-20T21:14:56.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54556
20102024-12-20T21:14:56.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54556 req_id = 5f7fcf73-c80c-4835-becf-79224ff2a9aa response_code = 200 uri = /v2p
20112024-12-20T21:14:56.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61406
20122024-12-20T21:14:56.666ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20132024-12-20T21:14:56.706ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20142024-12-20T21:14:56.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93124 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61406 req_id = 3ce65659-2adc-458f-9385-415de0e18a5e response_code = 204 uri = /switch-ports
20152024-12-20T21:14:56.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61406 req_id = 131fb1e6-f744-4ab1-8460-f90bceb0b023 response_code = 200 uri = /network-bootstore-config
20162024-12-20T21:14:56.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39511
20172024-12-20T21:14:56.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39511 req_id = 91732dd1-2185-4cc2-a3d9-7e2c8ad8d672 response_code = 200 uri = /vpc-routes
20182024-12-20T21:14:56.782ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
20192024-12-20T21:14:56.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39511 req_id = 1112ed31-14c6-48cf-b906-81b54c760f09 response_code = 204 uri = /eip-gateways
20202024-12-20T21:14:56.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39511 req_id = 5abb9497-3b09-4b14-b147-deabdea7830c response_code = 204 uri = /vpc-routes
20212024-12-20T21:14:56.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49669
20222024-12-20T21:14:56.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49669 req_id = 415ca0c6-e179-444a-8843-b61edd30a09e response_code = 200 uri = /v2p
20232024-12-20T21:14:56.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57568
20242024-12-20T21:14:56.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20252024-12-20T21:14:56.916ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20262024-12-20T21:14:56.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57568 req_id = 69748c6b-c1fd-4980-985b-827863ded2c1 response_code = 204 uri = /switch-ports
20272024-12-20T21:14:56.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57568 req_id = e18b94f9-7b9d-406f-a28d-287866618234 response_code = 200 uri = /network-bootstore-config
20282024-12-20T21:15:02.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50782
20292024-12-20T21:15:02.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50782 req_id = 48c9916d-6fb6-4b58-ba71-3ce88a19ad31 response_code = 200 uri = /vpc-routes
20302024-12-20T21:15:02.677ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
20312024-12-20T21:15:02.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50782 req_id = 7f270d3f-9ef7-4a26-88f3-a2a58cfca205 response_code = 204 uri = /eip-gateways
20322024-12-20T21:15:02.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50782 req_id = 52b826aa-9964-4ad7-84c8-041e89ada1f6 response_code = 204 uri = /vpc-routes
20332024-12-20T21:15:02.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59016
20342024-12-20T21:15:02.845ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20352024-12-20T21:15:02.892ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20362024-12-20T21:15:02.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116428 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59016 req_id = 2baa5d7c-f021-49d7-a53d-322cbe8fcd9a response_code = 204 uri = /switch-ports
20372024-12-20T21:15:02.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36797
20382024-12-20T21:15:02.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59016 req_id = 47fbd04b-3044-44db-8024-ca5e183d6e97 response_code = 200 uri = /network-bootstore-config
20392024-12-20T21:15:02.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36797 req_id = 145f3f81-2f46-48a8-89e4-a94fccb2ec3d response_code = 200 uri = /v2p
20402024-12-20T21:15:09.117ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8464 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 9719b55a-0ca7-4369-8596-0fef929dcc26 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
20412024-12-20T21:15:16.000ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51594
20422024-12-20T21:15:16.000ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51594 req_id = c379fad0-5b7a-4419-9f5d-7d166053f9fd response_code = 200 uri = /baseboard
20432024-12-20T21:15:24.941ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20442024-12-20T21:15:26.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59911
20452024-12-20T21:15:26.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59911 req_id = b2760e2f-b866-438a-8683-1fcce8cd5412 response_code = 200 uri = /v2p
20462024-12-20T21:15:26.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35297
20472024-12-20T21:15:26.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35297 req_id = 4e159088-0b2f-4af5-9560-a1be1e669c94 response_code = 200 uri = /vpc-routes
20482024-12-20T21:15:26.956ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
20492024-12-20T21:15:26.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35297 req_id = 601acf33-4e8d-4ffc-bbea-23b8134fb18f response_code = 204 uri = /eip-gateways
20502024-12-20T21:15:26.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35297 req_id = 95fbd936-fd33-487a-ab76-a00e0cf9e678 response_code = 204 uri = /vpc-routes
20512024-12-20T21:15:26.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44679
20522024-12-20T21:15:26.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44679 req_id = 7c878540-d83e-4a89-9a3a-2e003a31acb2 response_code = 200 uri = /vpc-routes
20532024-12-20T21:15:27.013ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
20542024-12-20T21:15:27.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44679 req_id = 3c842ab5-80de-498f-93ec-ca502d31b1d5 response_code = 204 uri = /eip-gateways
20552024-12-20T21:15:27.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44679 req_id = 507a6436-ad0b-4e5b-ac22-1624d20cb41f response_code = 204 uri = /vpc-routes
20562024-12-20T21:15:27.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44185
20572024-12-20T21:15:27.036ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20582024-12-20T21:15:27.072ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20592024-12-20T21:15:27.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90739 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44185 req_id = b965db67-e3f5-488e-b240-be26283b9bdf response_code = 204 uri = /switch-ports
20602024-12-20T21:15:27.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44185 req_id = 062eaf82-bbe1-42a7-bab4-0f044a159585 response_code = 200 uri = /network-bootstore-config
20612024-12-20T21:15:27.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49780
20622024-12-20T21:15:27.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49780 req_id = 18d513fd-d844-49ee-8724-f7b8df35019b response_code = 200 uri = /v2p
20632024-12-20T21:15:27.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37434
20642024-12-20T21:15:27.302ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20652024-12-20T21:15:27.337ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20662024-12-20T21:15:27.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92248 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37434 req_id = 0affd1f5-417b-4835-9eff-45cbfa4cb818 response_code = 204 uri = /switch-ports
20672024-12-20T21:15:27.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37434 req_id = 8a786e91-e44a-42c3-8af4-4083bd997e01 response_code = 200 uri = /network-bootstore-config
20682024-12-20T21:15:32.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64481
20692024-12-20T21:15:32.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64481 req_id = 0f1e2916-3831-4a6d-834c-6fdafa8c45be response_code = 200 uri = /vpc-routes
20702024-12-20T21:15:32.817ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
20712024-12-20T21:15:32.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64481 req_id = d290ffcd-6882-4c70-974c-e59aa22748f7 response_code = 204 uri = /eip-gateways
20722024-12-20T21:15:32.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57775
20732024-12-20T21:15:32.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57775 req_id = 23c5de6e-149e-49d6-9dab-3b442fec2916 response_code = 200 uri = /v2p
20742024-12-20T21:15:32.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64481 req_id = 1c94a61a-e483-4a34-aaa5-13224ac10def response_code = 204 uri = /vpc-routes
20752024-12-20T21:15:32.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45000
20762024-12-20T21:15:32.961ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20772024-12-20T21:15:32.998ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20782024-12-20T21:15:33.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45000 req_id = 8f89d228-40f2-4dcf-9881-e3dbc7ef7b86 response_code = 204 uri = /switch-ports
20792024-12-20T21:15:33.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45000 req_id = 5c11b815-9d24-4316-a568-7649f42bc5c6 response_code = 200 uri = /network-bootstore-config
20802024-12-20T21:15:39.114ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6586 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 3cdc9e73-f36c-4fb8-8779-3aaf6f4b7679 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
20812024-12-20T21:15:46.031ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38432
20822024-12-20T21:15:46.031ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38432 req_id = cf82e8f6-ce33-4112-927a-16a0c48e9fa6 response_code = 200 uri = /baseboard
20832024-12-20T21:15:56.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41624
20842024-12-20T21:15:56.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41624 req_id = 03b1cd37-f479-4e8c-b182-44e567904bc2 response_code = 200 uri = /vpc-routes
20852024-12-20T21:15:56.479ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
20862024-12-20T21:15:56.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41624 req_id = 38d8964b-1dcc-4be1-9073-8c974a27a094 response_code = 204 uri = /eip-gateways
20872024-12-20T21:15:56.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41624 req_id = 3373088b-ad4d-4eaf-b5fb-be752b0d4d62 response_code = 204 uri = /vpc-routes
20882024-12-20T21:15:56.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63827
20892024-12-20T21:15:56.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63827 req_id = 80af4abe-2d9e-4c5a-82ba-a25138f76e83 response_code = 200 uri = /v2p
20902024-12-20T21:15:56.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38784
20912024-12-20T21:15:56.602ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20922024-12-20T21:15:56.654ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20932024-12-20T21:15:56.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127002 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38784 req_id = 1701a4d9-5aa7-4d00-834e-96a5a70706ff response_code = 204 uri = /switch-ports
20942024-12-20T21:15:56.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38784 req_id = b9d43261-5baa-4134-a7db-97dafdd4df42 response_code = 200 uri = /network-bootstore-config
20952024-12-20T21:15:56.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44081
20962024-12-20T21:15:56.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44081 req_id = 356471b0-c02e-4681-9427-91280eb5b300 response_code = 200 uri = /v2p
20972024-12-20T21:15:56.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36446
20982024-12-20T21:15:56.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36446 req_id = b59901ba-a09c-4a04-885f-c60b66c4c86b response_code = 200 uri = /vpc-routes
20992024-12-20T21:15:57.021ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
21002024-12-20T21:15:57.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36446 req_id = 88934369-203f-4b5c-88ad-31e01ed4d757 response_code = 204 uri = /eip-gateways
21012024-12-20T21:15:57.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36446 req_id = 0dd6635c-04b9-4233-8884-7e901b968d2d response_code = 204 uri = /vpc-routes
21022024-12-20T21:15:57.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38396
21032024-12-20T21:15:57.056ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21042024-12-20T21:15:57.094ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21052024-12-20T21:15:57.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91908 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38396 req_id = 342624ed-42ee-4a1e-90bf-ab9995b1f456 response_code = 204 uri = /switch-ports
21062024-12-20T21:15:57.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38396 req_id = b725cf66-951b-4ac3-94cc-e14e6130c096 response_code = 200 uri = /network-bootstore-config
21072024-12-20T21:16:02.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46129
21082024-12-20T21:16:02.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46129 req_id = 19aa9024-d10b-4531-979f-a3a0491ec78f response_code = 200 uri = /v2p
21092024-12-20T21:16:02.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38545
21102024-12-20T21:16:02.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38545 req_id = af5d3964-8c36-43aa-908b-3d3e9fdd48b2 response_code = 200 uri = /vpc-routes
21112024-12-20T21:16:02.676ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
21122024-12-20T21:16:02.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38545 req_id = dfb6cf57-324b-466a-b2c9-37cc3fde092a response_code = 204 uri = /eip-gateways
21132024-12-20T21:16:02.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38545 req_id = 23513f1a-d77c-4ddb-87ef-6c40f6ff306f response_code = 204 uri = /vpc-routes
21142024-12-20T21:16:02.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53361
21152024-12-20T21:16:02.741ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21162024-12-20T21:16:02.777ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21172024-12-20T21:16:02.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89841 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53361 req_id = 9c55adc1-9e83-4f18-90b5-2d1493a49ef8 response_code = 204 uri = /switch-ports
21182024-12-20T21:16:02.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53361 req_id = bf840ed5-0735-4839-97ad-87b9be9bce83 response_code = 200 uri = /network-bootstore-config
21192024-12-20T21:16:09.114ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6945 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = fb338401-92b1-4731-aca2-45cc1c6bf871 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
21202024-12-20T21:16:16.063ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55749
21212024-12-20T21:16:16.064ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55749 req_id = ab8a6c7f-c677-4855-b67a-584c219ba9f9 response_code = 200 uri = /baseboard
21222024-12-20T21:16:26.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48947
21232024-12-20T21:16:26.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48947 req_id = e69bf713-d324-4bd9-a244-b81d11601da0 response_code = 200 uri = /vpc-routes
21242024-12-20T21:16:26.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38398
21252024-12-20T21:16:26.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38398 req_id = 67a3f25d-9e7c-43dc-bd3d-0c326daadc9a response_code = 200 uri = /v2p
21262024-12-20T21:16:26.743ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
21272024-12-20T21:16:26.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48947 req_id = fc3bf9a0-6c97-4f91-962b-b31d489ea217 response_code = 204 uri = /eip-gateways
21282024-12-20T21:16:26.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48947 req_id = 2ff58d13-77fd-42ba-a1c6-e5cdad5c203f response_code = 204 uri = /vpc-routes
21292024-12-20T21:16:26.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35755
21302024-12-20T21:16:26.817ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21312024-12-20T21:16:26.855ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21322024-12-20T21:16:26.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98140 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35755 req_id = 6ba60bc3-b28c-4fa6-bf8f-fdd0c0b5eea6 response_code = 204 uri = /switch-ports
21332024-12-20T21:16:26.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35755 req_id = 9dc0ab41-2c85-4a57-b99e-6976d2e7d334 response_code = 200 uri = /network-bootstore-config
21342024-12-20T21:16:26.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52189
21352024-12-20T21:16:26.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52189 req_id = 3f1af3d4-4b5e-4c8e-b1df-a0dc2de939d5 response_code = 200 uri = /vpc-routes
21362024-12-20T21:16:26.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33903
21372024-12-20T21:16:26.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33903 req_id = 40cd6460-f3a8-4fc5-beb5-7bab0675bf3c response_code = 200 uri = /v2p
21382024-12-20T21:16:27.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
21392024-12-20T21:16:27.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52189 req_id = 618fbeba-6f9e-4540-944a-f9ea16c6ba77 response_code = 204 uri = /eip-gateways
21402024-12-20T21:16:27.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52189 req_id = 2471c116-0cd2-41e9-aaba-03d6524d6989 response_code = 204 uri = /vpc-routes
21412024-12-20T21:16:27.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53065
21422024-12-20T21:16:27.121ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21432024-12-20T21:16:27.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21442024-12-20T21:16:27.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95098 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53065 req_id = f0536d70-cc75-4cd9-9d44-b8b737cdd12f response_code = 204 uri = /switch-ports
21452024-12-20T21:16:27.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53065 req_id = 4e783636-eebc-4ca0-9f59-c83d12380a3a response_code = 200 uri = /network-bootstore-config
21462024-12-20T21:16:32.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41149
21472024-12-20T21:16:32.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41149 req_id = 5d1118a3-e7af-4b1f-854e-0c32e532f341 response_code = 200 uri = /vpc-routes
21482024-12-20T21:16:32.797ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
21492024-12-20T21:16:32.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41149 req_id = 7ee80fe5-627d-45cc-bcbc-87ff394be263 response_code = 204 uri = /eip-gateways
21502024-12-20T21:16:32.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35566
21512024-12-20T21:16:32.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35566 req_id = eb2bd57c-6053-41f3-83c2-c7297bcda046 response_code = 200 uri = /v2p
21522024-12-20T21:16:32.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41149 req_id = 796acb6d-06db-4253-87a7-ba7439563f64 response_code = 204 uri = /vpc-routes
21532024-12-20T21:16:32.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39145
21542024-12-20T21:16:32.927ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21552024-12-20T21:16:32.964ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21562024-12-20T21:16:33.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92224 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39145 req_id = 88db88c1-31b7-4c1a-b3a2-b2c0e1215984 response_code = 204 uri = /switch-ports
21572024-12-20T21:16:33.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39145 req_id = 151446b0-fe95-4a58-bc0e-cfb166edbde8 response_code = 200 uri = /network-bootstore-config
21582024-12-20T21:16:39.114ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7741 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 768fa39c-fef4-42ee-832e-d112ddf3cc56 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
21592024-12-20T21:16:46.103ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48685
21602024-12-20T21:16:46.103ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48685 req_id = bc329684-46ca-4d3d-9e0a-78c14309b966 response_code = 200 uri = /baseboard
21612024-12-20T21:16:56.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50594
21622024-12-20T21:16:56.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50594 req_id = b40f0aab-5d3b-4a6f-b2a5-aa145524ae28 response_code = 200 uri = /vpc-routes
21632024-12-20T21:16:56.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53577
21642024-12-20T21:16:56.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53577 req_id = 19aebd42-59be-4c9a-b785-962e46619fc6 response_code = 200 uri = /v2p
21652024-12-20T21:16:56.600ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
21662024-12-20T21:16:56.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50594 req_id = 96dd8141-cb12-46f3-be25-5ba8d8e9cf1d response_code = 204 uri = /eip-gateways
21672024-12-20T21:16:56.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40050
21682024-12-20T21:16:56.603ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21692024-12-20T21:16:56.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21702024-12-20T21:16:56.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122373 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40050 req_id = ca2f33de-26b8-493c-9fc2-e5ff1cc8d880 response_code = 204 uri = /switch-ports
21712024-12-20T21:16:56.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41058
21722024-12-20T21:16:56.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50594 req_id = 81490cd1-c85e-49ef-ba7e-aa1f9bf5f4f2 response_code = 204 uri = /vpc-routes
21732024-12-20T21:16:56.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41058 req_id = 906bfba0-9807-48b0-8e9a-3e6d232b4793 response_code = 200 uri = /vpc-routes
21742024-12-20T21:16:56.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40050 req_id = 7c745002-79c3-42b5-8cc5-66b66029bb04 response_code = 200 uri = /network-bootstore-config
21752024-12-20T21:16:56.767ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
21762024-12-20T21:16:56.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41058 req_id = 28b019f2-3286-4b72-856f-b65201f7420a response_code = 204 uri = /eip-gateways
21772024-12-20T21:16:56.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47287
21782024-12-20T21:16:56.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47287 req_id = 6cecb4c0-711e-4125-8110-cb8bbede74d6 response_code = 200 uri = /v2p
21792024-12-20T21:16:56.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54705
21802024-12-20T21:16:56.946ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21812024-12-20T21:16:56.984ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21822024-12-20T21:16:57.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95178 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54705 req_id = d0297533-49f4-4749-865f-be352b7e21a4 response_code = 204 uri = /switch-ports
21832024-12-20T21:16:57.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54705 req_id = 5089c442-0de3-402d-b400-26f5f6eb8d35 response_code = 200 uri = /network-bootstore-config
21842024-12-20T21:16:57.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41058 req_id = d15b53e7-0e3c-44a5-bc7f-7c5b96da7f93 response_code = 204 uri = /vpc-routes
21852024-12-20T21:17:02.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61781
21862024-12-20T21:17:02.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61781 req_id = e300156e-c0df-45b5-85bf-2b01d011a058 response_code = 200 uri = /vpc-routes
21872024-12-20T21:17:02.672ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
21882024-12-20T21:17:02.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61781 req_id = 0b15d0de-dad0-4bd9-b9ec-235209bdec1f response_code = 204 uri = /eip-gateways
21892024-12-20T21:17:02.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43876
21902024-12-20T21:17:02.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43876 req_id = 00a76142-7a3c-4c07-b478-ef09882ef64e response_code = 200 uri = /v2p
21912024-12-20T21:17:02.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61781 req_id = b87205a7-f47e-49b5-b237-61f1b00bfcc6 response_code = 204 uri = /vpc-routes
21922024-12-20T21:17:02.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60806
21932024-12-20T21:17:02.719ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21942024-12-20T21:17:02.755ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21952024-12-20T21:17:02.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88687 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60806 req_id = b1c0ab9f-070e-4feb-b3f6-7283f5163e0c response_code = 204 uri = /switch-ports
21962024-12-20T21:17:02.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60806 req_id = 63ffe142-f76e-4ff5-9e86-8c1d493e0638 response_code = 200 uri = /network-bootstore-config
21972024-12-20T21:17:09.114ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7628 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = ccf94502-1053-4ab1-994c-0e1995582e13 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
21982024-12-20T21:17:16.137ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53298
21992024-12-20T21:17:16.137ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53298 req_id = 4b8e312a-a5ee-4188-8848-be26b5c80e01 response_code = 200 uri = /baseboard
22002024-12-20T21:17:26.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53255
22012024-12-20T21:17:26.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53255 req_id = 15590305-a957-488c-a0ed-5615c89cd3c4 response_code = 200 uri = /vpc-routes
22022024-12-20T21:17:26.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50300
22032024-12-20T21:17:26.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50300 req_id = 5ce3a08a-de74-41cb-8972-e1ea5e74b748 response_code = 200 uri = /v2p
22042024-12-20T21:17:26.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
22052024-12-20T21:17:26.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53255 req_id = 6e16f87f-9b91-499b-9065-636326f85fa5 response_code = 204 uri = /eip-gateways
22062024-12-20T21:17:26.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53255 req_id = 75677dbb-8db2-453d-ac36-7eab83848775 response_code = 204 uri = /vpc-routes
22072024-12-20T21:17:26.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41649
22082024-12-20T21:17:26.888ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22092024-12-20T21:17:26.926ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22102024-12-20T21:17:26.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90609 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41649 req_id = f05ae0e0-62bf-4489-b600-b05269f61d06 response_code = 204 uri = /switch-ports
22112024-12-20T21:17:26.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43460
22122024-12-20T21:17:26.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54299
22132024-12-20T21:17:26.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41649 req_id = ee4c3f60-29dc-4b6b-b86a-071674f083d2 response_code = 200 uri = /network-bootstore-config
22142024-12-20T21:17:26.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54299 req_id = 9c359053-1efe-437b-8868-c6d2e457a5a3 response_code = 200 uri = /vpc-routes
22152024-12-20T21:17:26.980ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22162024-12-20T21:17:26.980ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22172024-12-20T21:17:26.980ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22182024-12-20T21:17:26.980ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22192024-12-20T21:17:26.980ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22202024-12-20T21:17:26.980ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22212024-12-20T21:17:26.980ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22222024-12-20T21:17:26.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 392 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43460 req_id = c9d33495-fc49-44b9-a0bf-3c7177db1220 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22232024-12-20T21:17:27.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49306
22242024-12-20T21:17:27.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49306 req_id = e3eab565-4b7d-43fe-911b-3f7b5dc3c1ac response_code = 200 uri = /v2p
22252024-12-20T21:17:27.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
22262024-12-20T21:17:27.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54299 req_id = 852dfec0-86ad-4d45-aad8-7136375dc406 response_code = 204 uri = /eip-gateways
22272024-12-20T21:17:27.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54299 req_id = 76ca4fec-1bda-46c5-9c8f-8c5bc1a23f72 response_code = 204 uri = /vpc-routes
22282024-12-20T21:17:27.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33532
22292024-12-20T21:17:27.211ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22302024-12-20T21:17:27.250ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22312024-12-20T21:17:27.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95923 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33532 req_id = 576456c3-1701-4f5b-9e0d-cbf6ad90b851 response_code = 204 uri = /switch-ports
22322024-12-20T21:17:27.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43294
22332024-12-20T21:17:27.307ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22342024-12-20T21:17:27.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33532 req_id = 88d9d3e9-5982-4acb-b33f-dc114617de33 response_code = 200 uri = /network-bootstore-config
22352024-12-20T21:17:27.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22362024-12-20T21:17:27.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22372024-12-20T21:17:27.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22382024-12-20T21:17:27.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22392024-12-20T21:17:27.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22402024-12-20T21:17:27.307ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22412024-12-20T21:17:27.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43294 req_id = 8db2875b-5cbf-434a-9e19-48e053035a76 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22422024-12-20T21:17:32.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43056
22432024-12-20T21:17:32.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43056 req_id = 676e5abb-eaf0-4ac5-8246-6d1b8a43b102 response_code = 200 uri = /vpc-routes
22442024-12-20T21:17:32.872ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
22452024-12-20T21:17:32.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43056 req_id = dd3d0b9c-7a7c-4978-8229-355d9aaf9862 response_code = 204 uri = /eip-gateways
22462024-12-20T21:17:32.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37516
22472024-12-20T21:17:32.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37516 req_id = ea9609ac-fd8f-4ba7-82aa-7b14a18e65d2 response_code = 200 uri = /v2p
22482024-12-20T21:17:32.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43056 req_id = 50787d3d-4aa7-4721-af1e-94cf27bd1446 response_code = 204 uri = /vpc-routes
22492024-12-20T21:17:33.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39425
22502024-12-20T21:17:33.182ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22512024-12-20T21:17:33.182ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22522024-12-20T21:17:33.182ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22532024-12-20T21:17:33.182ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22542024-12-20T21:17:33.182ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22552024-12-20T21:17:33.182ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22562024-12-20T21:17:33.182ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22572024-12-20T21:17:33.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39425 req_id = d7b0c377-ba38-4bf2-b23e-b7776f1fde31 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22582024-12-20T21:17:33.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51828
22592024-12-20T21:17:33.292ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22602024-12-20T21:17:33.330ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22612024-12-20T21:17:33.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97412 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51828 req_id = feae60aa-3275-4b54-9272-ba0f5f04836b response_code = 204 uri = /switch-ports
22622024-12-20T21:17:33.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51828 req_id = ef4c0f1d-c9fd-408a-8aa8-21d5dc94b80f response_code = 200 uri = /network-bootstore-config
22632024-12-20T21:17:39.118ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11241 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = d332195b-392e-496a-a023-f17d7243fdd2 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
22642024-12-20T21:17:46.170ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43349
22652024-12-20T21:17:46.170ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43349 req_id = ab149e8b-7688-4e83-92d5-a3a8e4f526bf response_code = 200 uri = /baseboard
22662024-12-20T21:17:56.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58334
22672024-12-20T21:17:56.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58334 req_id = 188b30a3-aa01-4aa7-b802-3f7459e9796c response_code = 200 uri = /vpc-routes
22682024-12-20T21:17:56.524ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
22692024-12-20T21:17:56.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58334 req_id = f6a8ac46-8d38-4251-ac8e-8708d633c86f response_code = 204 uri = /eip-gateways
22702024-12-20T21:17:56.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38734
22712024-12-20T21:17:56.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38734 req_id = 313e216d-5674-4a97-84cc-33c12589e140 response_code = 200 uri = /v2p
22722024-12-20T21:17:56.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58334 req_id = a3a49b5c-9f01-40a0-9a45-feb727f2c22d response_code = 204 uri = /vpc-routes
22732024-12-20T21:17:56.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57022
22742024-12-20T21:17:56.615ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22752024-12-20T21:17:56.670ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22762024-12-20T21:17:56.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134231 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57022 req_id = 1df2ccba-f398-4f40-9daa-3fa16aa1299a response_code = 204 uri = /switch-ports
22772024-12-20T21:17:56.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57022 req_id = 7fea2034-0aad-4945-82ba-dd8efb2bcd7c response_code = 200 uri = /network-bootstore-config
22782024-12-20T21:17:56.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55749
22792024-12-20T21:17:56.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55749 req_id = ee7db345-5311-4bf2-9798-6abeb805fa84 response_code = 200 uri = /vpc-routes
22802024-12-20T21:17:56.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39327
22812024-12-20T21:17:56.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39327 req_id = 887ce8c7-5927-4f06-a8d1-24986ae5b1ad response_code = 200 uri = /v2p
22822024-12-20T21:17:56.939ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
22832024-12-20T21:17:56.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55749 req_id = 65780957-14ca-49c0-9aa1-e7f848a00453 response_code = 204 uri = /eip-gateways
22842024-12-20T21:17:56.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55749 req_id = 0984d8f8-a6d3-49d7-90ec-cbdc7eeca1a0 response_code = 204 uri = /vpc-routes
22852024-12-20T21:17:56.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41883
22862024-12-20T21:17:56.980ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22872024-12-20T21:17:57.015ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22882024-12-20T21:17:57.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41883 req_id = ded36a04-2758-48ec-ab04-12c3e1e66017 response_code = 204 uri = /switch-ports
22892024-12-20T21:17:57.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41883 req_id = 9d627972-aa0a-477e-a76b-7a6e3a82f0be response_code = 200 uri = /network-bootstore-config
22902024-12-20T21:18:02.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61376
22912024-12-20T21:18:02.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61376 req_id = 9e8c64e9-1533-43a9-9492-bb068315c4ec response_code = 200 uri = /vpc-routes
22922024-12-20T21:18:02.656ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
22932024-12-20T21:18:02.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61376 req_id = ed64b0ed-f874-448c-a9ad-8f2544770cb7 response_code = 204 uri = /eip-gateways
22942024-12-20T21:18:02.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61376 req_id = 4f39cc8c-2591-4d5c-819d-d9bc46d5b178 response_code = 204 uri = /vpc-routes
22952024-12-20T21:18:02.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49356
22962024-12-20T21:18:02.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49356 req_id = c17b587a-5d6b-4218-a4da-18314d6ba9a0 response_code = 200 uri = /v2p
22972024-12-20T21:18:02.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60041
22982024-12-20T21:18:02.846ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22992024-12-20T21:18:02.883ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23002024-12-20T21:18:02.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91211 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60041 req_id = ff1f276d-83b3-4dc4-8c85-631a3233706f response_code = 204 uri = /switch-ports
23012024-12-20T21:18:02.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60041 req_id = 07d28867-9305-490d-9635-ca3ffcac138c response_code = 200 uri = /network-bootstore-config
23022024-12-20T21:18:09.113ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7156 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 9c403d2d-11b2-4822-93f6-a28f0098a1e1 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
23032024-12-20T21:18:16.201ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64845
23042024-12-20T21:18:16.201ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64845 req_id = e214957c-91dc-4e0c-92e6-e905fc3c8807 response_code = 200 uri = /baseboard
23052024-12-20T21:18:26.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57696
23062024-12-20T21:18:26.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57696 req_id = 59f55acc-51cc-43f1-be87-3eae9b446636 response_code = 200 uri = /vpc-routes
23072024-12-20T21:18:26.582ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
23082024-12-20T21:18:26.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57696 req_id = b42df087-a6ab-40d6-8a87-f87dd72dfc1e response_code = 204 uri = /eip-gateways
23092024-12-20T21:18:26.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57696 req_id = 7dfd2617-2590-4089-a370-0d42bb1e6c84 response_code = 204 uri = /vpc-routes
23102024-12-20T21:18:26.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51870
23112024-12-20T21:18:26.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51870 req_id = f32af840-24cf-4295-98a8-7d6df8fc350d response_code = 200 uri = /v2p
23122024-12-20T21:18:26.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50381
23132024-12-20T21:18:26.933ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23142024-12-20T21:18:26.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23152024-12-20T21:18:27.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95154 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50381 req_id = 3072138d-321d-4e76-b074-c2302753b65c response_code = 204 uri = /switch-ports
23162024-12-20T21:18:27.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34022
23172024-12-20T21:18:27.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64740
23182024-12-20T21:18:27.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64740 req_id = a5880654-cd77-4438-a2a2-ede0223253f7 response_code = 200 uri = /v2p
23192024-12-20T21:18:27.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34022 req_id = f1c09fed-dc76-4a2a-8da0-427933bfcc30 response_code = 200 uri = /vpc-routes
23202024-12-20T21:18:27.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50381 req_id = 59f84cd9-f71c-49f7-9c8f-d245c4223847 response_code = 200 uri = /network-bootstore-config
23212024-12-20T21:18:27.070ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
23222024-12-20T21:18:27.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34022 req_id = 1d09ba15-a952-4a53-ab93-f60d54b61f7b response_code = 204 uri = /eip-gateways
23232024-12-20T21:18:27.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34022 req_id = 944e201b-1756-4b6d-affd-77458f7652b3 response_code = 204 uri = /vpc-routes
23242024-12-20T21:18:27.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55389
23252024-12-20T21:18:27.109ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23262024-12-20T21:18:27.148ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23272024-12-20T21:18:27.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98110 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55389 req_id = f6c58ffb-7118-40b3-8135-73ce76bc686a response_code = 204 uri = /switch-ports
23282024-12-20T21:18:27.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55389 req_id = 3100c8c1-3367-457a-8c47-d451952881f4 response_code = 200 uri = /network-bootstore-config
23292024-12-20T21:18:32.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54248
23302024-12-20T21:18:32.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54248 req_id = 3e970cb7-6720-4427-957a-205c3c81f650 response_code = 200 uri = /vpc-routes
23312024-12-20T21:18:32.729ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
23322024-12-20T21:18:32.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54248 req_id = bde32dda-a334-4c41-bdad-757b6cbbf498 response_code = 204 uri = /eip-gateways
23332024-12-20T21:18:32.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54248 req_id = 5d8f1a69-4f0c-4d8f-ac45-b27bab8b9c53 response_code = 204 uri = /vpc-routes
23342024-12-20T21:18:32.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33993
23352024-12-20T21:18:32.851ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23362024-12-20T21:18:32.888ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23372024-12-20T21:18:32.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87254 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33993 req_id = 15871125-81fe-41f8-b238-1ff11dbd3d7c response_code = 204 uri = /switch-ports
23382024-12-20T21:18:32.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63110
23392024-12-20T21:18:32.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63110 req_id = d3a4f5bc-89fa-4f0c-9556-b5b52ae1690f response_code = 200 uri = /v2p
23402024-12-20T21:18:32.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33993 req_id = 2b7688d1-f127-491d-ac00-1c09bce4dc66 response_code = 200 uri = /network-bootstore-config
23412024-12-20T21:18:39.113ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7237 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 146570a8-7097-44c4-92ca-f3a2b8ca0249 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
23422024-12-20T21:18:46.233ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39085
23432024-12-20T21:18:46.233ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39085 req_id = 687507ac-67a7-487c-be1d-b2a64a455d58 response_code = 200 uri = /baseboard
23442024-12-20T21:18:56.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48484
23452024-12-20T21:18:56.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48484 req_id = 95670816-cf8f-4b30-9353-ddd48c6c9353 response_code = 200 uri = /vpc-routes
23462024-12-20T21:18:56.521ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
23472024-12-20T21:18:56.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48484 req_id = 289d9825-d36c-49fc-a9bb-0e52ff203cf4 response_code = 204 uri = /eip-gateways
23482024-12-20T21:18:56.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48484 req_id = 7b41191e-244c-497b-a5cb-ee84036efecf response_code = 204 uri = /vpc-routes
23492024-12-20T21:18:56.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40462
23502024-12-20T21:18:56.582ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23512024-12-20T21:18:56.623ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23522024-12-20T21:18:56.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117654 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40462 req_id = c63645dd-c677-46be-84fc-969ecbfc80a0 response_code = 204 uri = /switch-ports
23532024-12-20T21:18:56.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48028
23542024-12-20T21:18:56.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48028 req_id = b8a84438-e8d3-459b-b028-52d5301cd59d response_code = 200 uri = /v2p
23552024-12-20T21:18:56.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40462 req_id = 024531c8-9a90-4989-a926-3d012621b58c response_code = 200 uri = /network-bootstore-config
23562024-12-20T21:18:56.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58037
23572024-12-20T21:18:56.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58037 req_id = 9f4d1c78-f66d-4119-a6ba-07b63333dedd response_code = 200 uri = /vpc-routes
23582024-12-20T21:18:56.822ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
23592024-12-20T21:18:56.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58037 req_id = 174f206c-8c9a-432a-86ef-b1fe4db77cf7 response_code = 204 uri = /eip-gateways
23602024-12-20T21:18:56.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61712
23612024-12-20T21:18:56.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61712 req_id = 87c2b57b-b26a-46b0-9c75-65371b1987b6 response_code = 200 uri = /v2p
23622024-12-20T21:18:56.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58037 req_id = 7c22467c-4852-4219-a9e4-dcd4016e0144 response_code = 204 uri = /vpc-routes
23632024-12-20T21:18:56.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64833
23642024-12-20T21:18:56.989ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23652024-12-20T21:18:57.026ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23662024-12-20T21:18:57.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94880 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64833 req_id = 4d0f52ec-7d57-448e-bfbc-fa578e08be00 response_code = 204 uri = /switch-ports
23672024-12-20T21:18:57.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64833 req_id = a1ebf781-2193-47f6-9f0f-16914dfc06f7 response_code = 200 uri = /network-bootstore-config
23682024-12-20T21:19:02.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34550
23692024-12-20T21:19:02.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34550 req_id = 6e3213af-e323-4ffa-aebf-e91d249118e4 response_code = 200 uri = /vpc-routes
23702024-12-20T21:19:02.731ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
23712024-12-20T21:19:02.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34550 req_id = 803ee4c7-496e-4aa0-a6b2-07cbf8b1043d response_code = 204 uri = /eip-gateways
23722024-12-20T21:19:02.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34550 req_id = 494d01fb-2b15-431b-be6d-6c4ff8ec4b34 response_code = 204 uri = /vpc-routes
23732024-12-20T21:19:02.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40959
23742024-12-20T21:19:02.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40959 req_id = 892a7f62-8bd3-4ad4-8b32-adc239cccd1b response_code = 200 uri = /v2p
23752024-12-20T21:19:02.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37805
23762024-12-20T21:19:02.798ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23772024-12-20T21:19:02.837ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23782024-12-20T21:19:02.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93467 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37805 req_id = a0878fce-a195-40fc-84c6-bf10a0d1ec02 response_code = 204 uri = /switch-ports
23792024-12-20T21:19:02.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37805 req_id = f6bebc66-e7af-47e6-aa2f-c1f67b7fd28f response_code = 200 uri = /network-bootstore-config
23802024-12-20T21:19:09.113ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7798 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 1a853b98-8eea-4a36-a3ff-df8000011a2f response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
23812024-12-20T21:19:16.267ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63422
23822024-12-20T21:19:16.267ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63422 req_id = e5b381e1-bb0f-41d5-8080-5bf407d1c69c response_code = 200 uri = /baseboard
23832024-12-20T21:19:26.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64724
23842024-12-20T21:19:26.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64724 req_id = deeafa70-de22-4898-b3ae-288cd7535fb8 response_code = 200 uri = /vpc-routes
23852024-12-20T21:19:26.704ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
23862024-12-20T21:19:26.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64724 req_id = 799ef0ce-86d4-49e9-be1c-d38b26a2a292 response_code = 204 uri = /eip-gateways
23872024-12-20T21:19:26.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36171
23882024-12-20T21:19:26.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36171 req_id = ceae75ad-2c5e-402c-8b49-800deb0fd247 response_code = 200 uri = /v2p
23892024-12-20T21:19:26.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64724 req_id = f5f7dfc4-bfca-458c-9673-805108222f78 response_code = 204 uri = /vpc-routes
23902024-12-20T21:19:26.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63597
23912024-12-20T21:19:26.939ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23922024-12-20T21:19:26.977ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23932024-12-20T21:19:27.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63597 req_id = 032806e1-4d6c-465b-b249-8759605b3ee7 response_code = 204 uri = /switch-ports
23942024-12-20T21:19:27.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36194
23952024-12-20T21:19:27.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36194 req_id = e343d0dd-5f0b-4e46-80a2-8175c19da3d3 response_code = 200 uri = /vpc-routes
23962024-12-20T21:19:27.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63597 req_id = de79becc-e694-42e0-96d8-7055d6c5d285 response_code = 200 uri = /network-bootstore-config
23972024-12-20T21:19:27.088ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
23982024-12-20T21:19:27.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36194 req_id = 250544c8-d72e-415d-9225-f2c798e4bd07 response_code = 204 uri = /eip-gateways
23992024-12-20T21:19:27.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62093
24002024-12-20T21:19:27.090ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24012024-12-20T21:19:27.129ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24022024-12-20T21:19:27.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62093 req_id = 9facad1a-15dd-47f9-a0b6-5e896517e43e response_code = 204 uri = /switch-ports
24032024-12-20T21:19:27.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62093 req_id = 1e52c8c2-01eb-4d6f-ba00-e37de06bdc9b response_code = 200 uri = /network-bootstore-config
24042024-12-20T21:19:27.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 419 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36194 req_id = 75ccf3bc-a79f-4477-8171-03e2b0d22c15 response_code = 204 uri = /vpc-routes
24052024-12-20T21:19:27.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53005
24062024-12-20T21:19:27.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53005 req_id = aa281e63-9299-491d-9a28-b8f8ec879af3 response_code = 200 uri = /v2p
24072024-12-20T21:19:32.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37195
24082024-12-20T21:19:32.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37195 req_id = 605e62e0-1343-44fe-8971-6d51580e03a5 response_code = 200 uri = /vpc-routes
24092024-12-20T21:19:32.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
24102024-12-20T21:19:32.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37195 req_id = 429b6998-9770-4b12-bf83-dd5495b11d18 response_code = 204 uri = /eip-gateways
24112024-12-20T21:19:32.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37195 req_id = 620b17ff-5c6f-4042-b466-ef8c9b40267c response_code = 204 uri = /vpc-routes
24122024-12-20T21:19:32.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46531
24132024-12-20T21:19:32.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46531 req_id = fe840a70-a1ce-4d48-b685-0cc0fd6e0513 response_code = 200 uri = /v2p
24142024-12-20T21:19:32.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61737
24152024-12-20T21:19:32.894ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24162024-12-20T21:19:32.932ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24172024-12-20T21:19:32.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91624 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61737 req_id = bdf51132-e639-461f-aed1-d6e8470d215f response_code = 204 uri = /switch-ports
24182024-12-20T21:19:32.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61737 req_id = ade1e4c9-aea6-4260-a5b4-722a915cefde response_code = 200 uri = /network-bootstore-config
24192024-12-20T21:19:39.111ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7182 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 8788dbd7-85c9-4509-be59-6c057601c35a response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
24202024-12-20T21:19:46.299ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52250
24212024-12-20T21:19:46.299ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52250 req_id = d7a2455a-0cd5-4358-9278-d6f87a4f5c44 response_code = 200 uri = /baseboard
24222024-12-20T21:19:56.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48943
24232024-12-20T21:19:56.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48943 req_id = de33ed9c-730a-4ff2-b679-4dfeb7c2ffab response_code = 200 uri = /vpc-routes
24242024-12-20T21:19:56.576ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
24252024-12-20T21:19:56.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48943 req_id = 4f325269-f3a2-469a-9592-7ecddd2803e4 response_code = 204 uri = /eip-gateways
24262024-12-20T21:19:56.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58091
24272024-12-20T21:19:56.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58091 req_id = e58f872e-3228-4add-a59d-f0c37409762e response_code = 200 uri = /v2p
24282024-12-20T21:19:56.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48943 req_id = d9fc0200-a6ee-42cd-84f4-092b9a9b73a6 response_code = 204 uri = /vpc-routes
24292024-12-20T21:19:56.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63994
24302024-12-20T21:19:56.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24312024-12-20T21:19:56.737ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24322024-12-20T21:19:56.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63994 req_id = 548a3888-1c92-4aaa-96b3-6ad2a08748d8 response_code = 204 uri = /switch-ports
24332024-12-20T21:19:56.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63994 req_id = 67264a7c-8dc1-4ec1-bcfc-4f4d4339d98c response_code = 200 uri = /network-bootstore-config
24342024-12-20T21:19:56.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53251
24352024-12-20T21:19:56.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53251 req_id = efa207ce-a26e-4737-9f80-2c242ee3eccd response_code = 200 uri = /vpc-routes
24362024-12-20T21:19:56.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
24372024-12-20T21:19:56.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53251 req_id = 79c2c4ee-a7b2-42c2-9482-6168e22f35de response_code = 204 uri = /eip-gateways
24382024-12-20T21:19:56.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50123
24392024-12-20T21:19:56.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50123 req_id = d2fddb21-30e6-4297-a323-64d4dceb4147 response_code = 200 uri = /v2p
24402024-12-20T21:19:56.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53251 req_id = 03c9151c-c5d8-447f-b8cc-e7dcf9d9333f response_code = 204 uri = /vpc-routes
24412024-12-20T21:19:56.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49904
24422024-12-20T21:19:56.975ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24432024-12-20T21:19:57.009ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24442024-12-20T21:19:57.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83074 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49904 req_id = 07eb6110-bed3-4549-a0e4-300a5c0d8ebd response_code = 204 uri = /switch-ports
24452024-12-20T21:19:57.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49904 req_id = be1f44b2-b99d-4fa7-9233-a74f16727fb9 response_code = 200 uri = /network-bootstore-config
24462024-12-20T21:20:02.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54010
24472024-12-20T21:20:02.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54010 req_id = 492a90c1-158b-44a5-97dc-ebd3ae3ac6b3 response_code = 200 uri = /vpc-routes
24482024-12-20T21:20:02.718ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
24492024-12-20T21:20:02.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54010 req_id = bb2a18a9-99f2-46ea-9dde-0995dfe13ede response_code = 204 uri = /eip-gateways
24502024-12-20T21:20:02.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54010 req_id = 4b28d5d1-324e-42a0-8c23-a68e4d653039 response_code = 204 uri = /vpc-routes
24512024-12-20T21:20:02.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55941
24522024-12-20T21:20:02.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55941 req_id = 45d8d362-642b-45fb-986b-48112c9df5c0 response_code = 200 uri = /v2p
24532024-12-20T21:20:02.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48718
24542024-12-20T21:20:02.884ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24552024-12-20T21:20:02.922ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24562024-12-20T21:20:02.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89638 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48718 req_id = 6edf9916-ed55-4551-af73-d6557c484dc8 response_code = 204 uri = /switch-ports
24572024-12-20T21:20:02.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48718 req_id = 57d86494-1f54-4c0a-ad6b-7904169a2782 response_code = 200 uri = /network-bootstore-config
24582024-12-20T21:20:09.111ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7428 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = e66f4acb-7fb4-44d6-b26f-8c8fa58b927b response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
24592024-12-20T21:20:10.799ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24602024-12-20T21:20:10.800ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24612024-12-20T21:20:10.826ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1730, tv_nsec: 196730946 } time_to_next_cleanup = 599.99999584s
24622024-12-20T21:20:16.332ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35170
24632024-12-20T21:20:16.332ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35170 req_id = 4b295c95-5dca-4f0b-8d05-3340b48caf14 response_code = 200 uri = /baseboard
24642024-12-20T21:20:24.938ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24652024-12-20T21:20:26.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47998
24662024-12-20T21:20:26.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47998 req_id = a2fdaf2b-4a9e-4847-8bb6-a78f2bfb6a2e response_code = 200 uri = /vpc-routes
24672024-12-20T21:20:26.587ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
24682024-12-20T21:20:26.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47998 req_id = b63acbe3-0bf5-4528-937f-2b03218393f2 response_code = 204 uri = /eip-gateways
24692024-12-20T21:20:26.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47998 req_id = c8633914-f15b-4c64-ba44-38d9135a9637 response_code = 204 uri = /vpc-routes
24702024-12-20T21:20:26.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45532
24712024-12-20T21:20:26.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24722024-12-20T21:20:26.856ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24732024-12-20T21:20:26.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110730 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45532 req_id = c8c5f6b5-ad61-4b09-8488-6d76bc70731c response_code = 204 uri = /switch-ports
24742024-12-20T21:20:26.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49349
24752024-12-20T21:20:26.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49349 req_id = 5887f694-8cc7-44ad-8b27-be7a622b81a3 response_code = 200 uri = /v2p
24762024-12-20T21:20:26.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45532 req_id = 6ac4db5f-03f5-4045-90d5-f7a80b8a2ad4 response_code = 200 uri = /network-bootstore-config
24772024-12-20T21:20:26.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34404
24782024-12-20T21:20:26.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34404 req_id = f43f6f66-e3f8-44a2-8839-bd4178b12dfe response_code = 200 uri = /vpc-routes
24792024-12-20T21:20:26.948ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
24802024-12-20T21:20:26.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34404 req_id = 7b9f5075-efec-4c7a-a619-1001e054da33 response_code = 204 uri = /eip-gateways
24812024-12-20T21:20:26.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34404 req_id = db1d3f50-9525-4e0f-be71-a18e3e5f6a5a response_code = 204 uri = /vpc-routes
24822024-12-20T21:20:27.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64244
24832024-12-20T21:20:27.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64244 req_id = d06e53c0-4cf1-4d1e-8ea8-40d9d88b2417 response_code = 200 uri = /v2p
24842024-12-20T21:20:27.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62055
24852024-12-20T21:20:27.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24862024-12-20T21:20:27.195ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24872024-12-20T21:20:27.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93342 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62055 req_id = 8838882c-f469-4e6e-b0c4-93ee0019d296 response_code = 204 uri = /switch-ports
24882024-12-20T21:20:27.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62055 req_id = 7e0262b4-a495-4cbb-b977-b4097faa2673 response_code = 200 uri = /network-bootstore-config
24892024-12-20T21:20:32.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45056
24902024-12-20T21:20:32.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45056 req_id = abe52689-4f25-415c-a22c-f1072246f95b response_code = 200 uri = /vpc-routes
24912024-12-20T21:20:32.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44663
24922024-12-20T21:20:32.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44663 req_id = 208b6921-c34f-49e1-8474-bbf0fca0a8f3 response_code = 200 uri = /v2p
24932024-12-20T21:20:32.822ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
24942024-12-20T21:20:32.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45056 req_id = 82fc924e-d1d4-4cd1-aa1f-860436fa4454 response_code = 204 uri = /eip-gateways
24952024-12-20T21:20:32.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45056 req_id = 99795575-4eb9-4ec3-9fe2-4b29222535eb response_code = 204 uri = /vpc-routes
24962024-12-20T21:20:32.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51396
24972024-12-20T21:20:32.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24982024-12-20T21:20:32.918ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24992024-12-20T21:20:32.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87271 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51396 req_id = 9ed94f21-5351-40fd-a716-b92ea7e72ba0 response_code = 204 uri = /switch-ports
25002024-12-20T21:20:32.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51396 req_id = 50e8e5e0-ce25-4b0e-9f0a-945954f71ce5 response_code = 200 uri = /network-bootstore-config
25012024-12-20T21:20:39.111ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7540 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 6948f647-f887-4ed7-a35f-67c9b448987c response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
25022024-12-20T21:20:46.364ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56487
25032024-12-20T21:20:46.364ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56487 req_id = 2f42a83b-7687-4265-96b1-da959460ce47 response_code = 200 uri = /baseboard
25042024-12-20T21:20:56.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42965
25052024-12-20T21:20:56.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42965 req_id = 53d5e372-6eaf-48ce-b1bb-bf3ff29c64a4 response_code = 200 uri = /v2p
25062024-12-20T21:20:56.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62061
25072024-12-20T21:20:56.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62061 req_id = 62a8e2cc-79ca-4b8d-bce5-821b817a5dc8 response_code = 200 uri = /vpc-routes
25082024-12-20T21:20:56.552ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
25092024-12-20T21:20:56.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62061 req_id = 15095382-d1a8-4bc2-8003-bcb787c85f84 response_code = 204 uri = /eip-gateways
25102024-12-20T21:20:56.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62061 req_id = 2e9307e8-56eb-47da-8df0-0a441d464752 response_code = 204 uri = /vpc-routes
25112024-12-20T21:20:56.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62668
25122024-12-20T21:20:56.639ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25132024-12-20T21:20:56.686ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25142024-12-20T21:20:56.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131592 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62668 req_id = b32b32de-bd39-44b8-b5f1-17a3e3a58d3a response_code = 204 uri = /switch-ports
25152024-12-20T21:20:56.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35264
25162024-12-20T21:20:56.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62668 req_id = 33d6dbef-7a02-4e1f-be6e-399cfbc661a4 response_code = 200 uri = /network-bootstore-config
25172024-12-20T21:20:56.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35264 req_id = 5bfc032f-eff5-46b4-ac84-2160d4d678d6 response_code = 200 uri = /vpc-routes
25182024-12-20T21:20:56.827ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
25192024-12-20T21:20:56.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35264 req_id = ed8a36bb-b331-4978-b3b5-a178f260ee41 response_code = 204 uri = /eip-gateways
25202024-12-20T21:20:56.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40999
25212024-12-20T21:20:56.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40999 req_id = 64540031-241e-404a-b2e3-9ff4c85acc0a response_code = 200 uri = /v2p
25222024-12-20T21:20:56.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35264 req_id = 4b99f85d-030e-4336-a842-585d4bc3258c response_code = 204 uri = /vpc-routes
25232024-12-20T21:20:56.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33000
25242024-12-20T21:20:56.981ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25252024-12-20T21:20:57.017ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25262024-12-20T21:20:57.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89978 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33000 req_id = 5c17666f-43a1-4c4c-bf01-8ecd4065a055 response_code = 204 uri = /switch-ports
25272024-12-20T21:20:57.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33000 req_id = 01ed4355-a409-4449-8105-9f915def1e78 response_code = 200 uri = /network-bootstore-config
25282024-12-20T21:21:02.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43998
25292024-12-20T21:21:02.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43998 req_id = 7c061893-c3a5-4b85-b237-71fd33820689 response_code = 200 uri = /v2p
25302024-12-20T21:21:02.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61463
25312024-12-20T21:21:02.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61463 req_id = 7d4aae94-bf79-454c-aea0-4db15d22c645 response_code = 200 uri = /vpc-routes
25322024-12-20T21:21:02.672ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
25332024-12-20T21:21:02.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61463 req_id = 53a08611-9fd9-4936-8eaa-148516d6852e response_code = 204 uri = /eip-gateways
25342024-12-20T21:21:02.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61463 req_id = e38f9041-817e-41cc-97d6-4fa5db938099 response_code = 204 uri = /vpc-routes
25352024-12-20T21:21:02.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51091
25362024-12-20T21:21:02.691ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25372024-12-20T21:21:02.730ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25382024-12-20T21:21:02.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97058 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51091 req_id = 99cea12f-128c-4e31-b177-bb3b0b088aec response_code = 204 uri = /switch-ports
25392024-12-20T21:21:02.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51091 req_id = c54b2a16-bca5-4212-892f-4aedadc1bb1a response_code = 200 uri = /network-bootstore-config
25402024-12-20T21:21:09.110ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7463 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 2254f7c1-9a8b-40cb-90e5-7d6a55a556f0 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
25412024-12-20T21:21:16.396ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38965
25422024-12-20T21:21:16.396ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38965 req_id = 2c9630fe-5545-4128-a761-aa1d479cd88e response_code = 200 uri = /baseboard
25432024-12-20T21:21:26.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62245
25442024-12-20T21:21:26.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62245 req_id = e956fdb7-a8b2-4154-9737-9143f6e547e6 response_code = 200 uri = /vpc-routes
25452024-12-20T21:21:26.657ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
25462024-12-20T21:21:26.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62245 req_id = 3dd83d30-2398-404d-973f-a041a0197a41 response_code = 204 uri = /eip-gateways
25472024-12-20T21:21:26.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43565
25482024-12-20T21:21:26.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43565 req_id = fd4d966f-2114-4aa2-8326-c5ad182e1df6 response_code = 200 uri = /v2p
25492024-12-20T21:21:26.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62245 req_id = 9b6490de-86d6-4833-bb33-56a94e1fb104 response_code = 204 uri = /vpc-routes
25502024-12-20T21:21:26.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45209
25512024-12-20T21:21:26.742ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25522024-12-20T21:21:26.781ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25532024-12-20T21:21:26.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90104 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45209 req_id = 2a8d4b5e-d4a2-4cac-8f90-9969208a2256 response_code = 204 uri = /switch-ports
25542024-12-20T21:21:26.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45209 req_id = 45c273a8-04d6-4155-bf50-b3d712f44502 response_code = 200 uri = /network-bootstore-config
25552024-12-20T21:21:26.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44886
25562024-12-20T21:21:26.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44886 req_id = e2d89d61-0e3d-4125-a8f6-e92d4310b855 response_code = 200 uri = /vpc-routes
25572024-12-20T21:21:27.038ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
25582024-12-20T21:21:27.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44886 req_id = 887fea7b-e173-4a17-bb5f-879208f17251 response_code = 204 uri = /eip-gateways
25592024-12-20T21:21:27.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44886 req_id = d793ee53-b90e-4b9c-9d6e-136882c69aff response_code = 204 uri = /vpc-routes
25602024-12-20T21:21:27.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40451
25612024-12-20T21:21:27.058ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25622024-12-20T21:21:27.093ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25632024-12-20T21:21:27.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93445 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40451 req_id = 4499153e-48d8-4c72-ac39-699716efb66e response_code = 204 uri = /switch-ports
25642024-12-20T21:21:27.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40451 req_id = fbd0767c-6810-4431-b99f-c1add5730019 response_code = 200 uri = /network-bootstore-config
25652024-12-20T21:21:27.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53428
25662024-12-20T21:21:27.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53428 req_id = fa436d0a-58bd-493b-a44e-6b2701c962ab response_code = 200 uri = /v2p
25672024-12-20T21:21:32.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63731
25682024-12-20T21:21:32.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63731 req_id = 9162edb3-48f9-4c55-a5f3-6852f24c601d response_code = 200 uri = /vpc-routes
25692024-12-20T21:21:32.962ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
25702024-12-20T21:21:32.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63731 req_id = 0d4d40b7-7b9b-40f2-9f9a-76f173d4d212 response_code = 204 uri = /eip-gateways
25712024-12-20T21:21:32.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63731 req_id = 691c576a-0cbe-4e6a-9048-1e11c2364623 response_code = 204 uri = /vpc-routes
25722024-12-20T21:21:33.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39024
25732024-12-20T21:21:33.001ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25742024-12-20T21:21:33.041ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25752024-12-20T21:21:33.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93933 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39024 req_id = fcd97520-a884-4dd8-a6c2-9980a6d8bd52 response_code = 204 uri = /switch-ports
25762024-12-20T21:21:33.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49388
25772024-12-20T21:21:33.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49388 req_id = 5f1d9244-cdd1-4aba-afc6-747b375ee23c response_code = 200 uri = /v2p
25782024-12-20T21:21:33.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39024 req_id = 74ec6bfe-9c06-46bc-adf2-aa58be62b828 response_code = 200 uri = /network-bootstore-config
25792024-12-20T21:21:39.112ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9229 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = fa585179-fbfd-4f58-ba12-4259ffb0be27 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
25802024-12-20T21:21:46.427ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33539
25812024-12-20T21:21:46.427ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33539 req_id = 641d7fb5-b2c4-4b8e-a1be-e04d6ce029cb response_code = 200 uri = /baseboard
25822024-12-20T21:21:56.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55726
25832024-12-20T21:21:56.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55726 req_id = a075e6fe-3cd7-4adf-a045-e57b574a89c4 response_code = 200 uri = /vpc-routes
25842024-12-20T21:21:56.439ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
25852024-12-20T21:21:56.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55726 req_id = 50c0098d-1bb4-482b-a113-79382aa675d0 response_code = 204 uri = /eip-gateways
25862024-12-20T21:21:56.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55726 req_id = 90907702-85b2-4c5c-bf8b-d64708045724 response_code = 204 uri = /vpc-routes
25872024-12-20T21:21:56.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47756
25882024-12-20T21:21:56.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47756 req_id = 73942d79-fbfb-45ce-8211-a871c1e2372c response_code = 200 uri = /v2p
25892024-12-20T21:21:56.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42981
25902024-12-20T21:21:56.641ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25912024-12-20T21:21:56.687ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25922024-12-20T21:21:56.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109387 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42981 req_id = a85b2f1e-2cd1-4e2d-90e9-fa2074cc0000 response_code = 204 uri = /switch-ports
25932024-12-20T21:21:56.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42981 req_id = 793b96ea-ebf7-4610-b75f-5d280ea59b00 response_code = 200 uri = /network-bootstore-config
25942024-12-20T21:21:56.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65069
25952024-12-20T21:21:56.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65069 req_id = 43a99ca3-eb8d-4ec5-a5b3-7b85f6120e8d response_code = 200 uri = /vpc-routes
25962024-12-20T21:21:56.866ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
25972024-12-20T21:21:56.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65069 req_id = 343cc708-461f-4b9f-a063-2fd78a326cdc response_code = 204 uri = /eip-gateways
25982024-12-20T21:21:56.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65069 req_id = 267a61e3-6171-4c45-bf28-260c58fe0ab2 response_code = 204 uri = /vpc-routes
25992024-12-20T21:21:56.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41447
26002024-12-20T21:21:56.914ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26012024-12-20T21:21:56.952ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26022024-12-20T21:21:57.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90816 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41447 req_id = 1392f36b-b24c-4f00-bc81-7feb2256bc30 response_code = 204 uri = /switch-ports
26032024-12-20T21:21:57.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49080
26042024-12-20T21:21:57.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49080 req_id = 916b1550-9f71-42b1-a75f-a606c2ea784e response_code = 200 uri = /v2p
26052024-12-20T21:21:57.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41447 req_id = 817786b2-e856-43e3-90a1-63a6c6e6bce6 response_code = 200 uri = /network-bootstore-config
26062024-12-20T21:22:02.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59170
26072024-12-20T21:22:02.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59170 req_id = 2273eab6-62b3-49a5-88ef-37fee80ee829 response_code = 200 uri = /vpc-routes
26082024-12-20T21:22:02.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
26092024-12-20T21:22:02.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59170 req_id = c79bb704-5b8c-4ee7-8a60-31f98eeb3c8e response_code = 204 uri = /eip-gateways
26102024-12-20T21:22:02.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59170 req_id = 5e196721-d61f-4c4c-b126-37909b6c3ead response_code = 204 uri = /vpc-routes
26112024-12-20T21:22:02.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42729
26122024-12-20T21:22:02.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42729 req_id = 77d77096-fc73-47ba-adfe-4b3c13c73102 response_code = 200 uri = /v2p
26132024-12-20T21:22:02.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37375
26142024-12-20T21:22:02.892ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26152024-12-20T21:22:02.926ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26162024-12-20T21:22:02.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86520 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37375 req_id = b8b4d0a8-2d01-43a9-9f43-7a364ece9a98 response_code = 204 uri = /switch-ports
26172024-12-20T21:22:02.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37375 req_id = e6514fc7-99d7-4a0c-bce6-6516b498a03b response_code = 200 uri = /network-bootstore-config
26182024-12-20T21:22:09.110ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7679 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = dbf64850-37f1-4e3a-b825-bdca6ffc8832 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
26192024-12-20T21:22:16.460ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59728
26202024-12-20T21:22:16.460ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59728 req_id = f99d19e0-0e24-467a-b7b7-7960a6835f09 response_code = 200 uri = /baseboard
26212024-12-20T21:22:26.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58427
26222024-12-20T21:22:26.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58427 req_id = 2fe7bca7-f6d9-49ed-9c04-b65a666be8dd response_code = 200 uri = /vpc-routes
26232024-12-20T21:22:26.719ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
26242024-12-20T21:22:26.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58427 req_id = 49537c26-66fe-4c29-ae82-af5e1e182667 response_code = 204 uri = /eip-gateways
26252024-12-20T21:22:26.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58726
26262024-12-20T21:22:26.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58726 req_id = e73c2f6a-1ee8-406f-9046-eaebdf7c9649 response_code = 200 uri = /v2p
26272024-12-20T21:22:26.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58427 req_id = a0b10c9b-597b-4d39-b6b0-f91162a1cce3 response_code = 204 uri = /vpc-routes
26282024-12-20T21:22:26.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42226
26292024-12-20T21:22:26.912ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26302024-12-20T21:22:26.912ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26312024-12-20T21:22:26.913ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-zones.json file = common/src/ledger.rs:177
26322024-12-20T21:22:26.913ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-zones.json file = common/src/ledger.rs:177
26332024-12-20T21:22:26.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58962
26342024-12-20T21:22:26.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58962 req_id = 8431a768-41f0-4aec-8e07-284213102b5b response_code = 200 uri = /vpc-routes
26352024-12-20T21:22:26.926ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26362024-12-20T21:22:26.926ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6cbb0b58-4d44-45b0-895e-d80165779045
26372024-12-20T21:22:26.955ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26382024-12-20T21:22:26.955ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8
26392024-12-20T21:22:26.975ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
26402024-12-20T21:22:26.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 646 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58962 req_id = 5673e826-6f2a-41e8-aaf0-360487cd9abe response_code = 204 uri = /eip-gateways
26412024-12-20T21:22:26.982ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26422024-12-20T21:22:26.982ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_70bee423-c23a-4941-9c18-69f4feca1839
26432024-12-20T21:22:27.007ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26442024-12-20T21:22:27.007ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d53f565a-e812-4053-98b4-59c34d29e75c
26452024-12-20T21:22:27.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58311
26462024-12-20T21:22:27.024ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26472024-12-20T21:22:27.030ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26482024-12-20T21:22:27.031ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75
26492024-12-20T21:22:27.053ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26502024-12-20T21:22:27.053ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4d0b1b25-4a74-46a6-945f-18014df947c1
26512024-12-20T21:22:27.059ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26522024-12-20T21:22:27.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50926
26532024-12-20T21:22:27.075ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26542024-12-20T21:22:27.075ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26552024-12-20T21:22:27.075ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-zones.json file = common/src/ledger.rs:177
26562024-12-20T21:22:27.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 652 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58962 req_id = 589365ad-22ba-4e3d-a292-165ce8ab7f56 response_code = 204 uri = /vpc-routes
26572024-12-20T21:22:27.075ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-zones.json file = common/src/ledger.rs:177
26582024-12-20T21:22:27.080ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26592024-12-20T21:22:27.080ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2
26602024-12-20T21:22:27.101ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26612024-12-20T21:22:27.101ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6cbb0b58-4d44-45b0-895e-d80165779045
26622024-12-20T21:22:27.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41049
26632024-12-20T21:22:27.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58311 req_id = 0497621f-8943-4082-a9ce-90ccfd7c1d52 response_code = 204 uri = /switch-ports
26642024-12-20T21:22:27.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48265
26652024-12-20T21:22:27.129ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26662024-12-20T21:22:27.132ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26672024-12-20T21:22:27.133ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8
26682024-12-20T21:22:27.133ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26692024-12-20T21:22:27.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26702024-12-20T21:22:27.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26712024-12-20T21:22:27.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26722024-12-20T21:22:27.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26732024-12-20T21:22:27.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26742024-12-20T21:22:27.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26752024-12-20T21:22:27.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8980 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48265 req_id = ab451ad9-1897-4e3d-857e-78a7e8008b61 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26762024-12-20T21:22:27.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58311 req_id = 0030cb04-8d90-423c-92bf-e322a2bb9385 response_code = 200 uri = /network-bootstore-config
26772024-12-20T21:22:27.147ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26782024-12-20T21:22:27.147ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94
26792024-12-20T21:22:27.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40154
26802024-12-20T21:22:27.164ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26812024-12-20T21:22:27.164ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_70bee423-c23a-4941-9c18-69f4feca1839
26822024-12-20T21:22:27.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40154 req_id = eeca129d-61b6-4c6c-bb2c-e53b5d069b3b response_code = 200 uri = /v2p
26832024-12-20T21:22:27.171ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26842024-12-20T21:22:27.179ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26852024-12-20T21:22:27.179ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e
26862024-12-20T21:22:27.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287044 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42226 req_id = ca1cd3c4-2c36-4a3c-ae06-ae63fc25e4cf response_code = 200 uri = /inventory
26872024-12-20T21:22:27.202ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26882024-12-20T21:22:27.202ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d53f565a-e812-4053-98b4-59c34d29e75c
26892024-12-20T21:22:27.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63294
26902024-12-20T21:22:27.206ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26912024-12-20T21:22:27.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26922024-12-20T21:22:27.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26932024-12-20T21:22:27.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26942024-12-20T21:22:27.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26952024-12-20T21:22:27.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26962024-12-20T21:22:27.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26972024-12-20T21:22:27.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 680 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63294 req_id = b2912146-4695-4692-b68b-2d5821767454 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26982024-12-20T21:22:27.223ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26992024-12-20T21:22:27.223ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75
27002024-12-20T21:22:27.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102444 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41049 req_id = 065f30f1-4cd7-4d31-954c-e2d52c58c569 response_code = 204 uri = /switch-ports
27012024-12-20T21:22:27.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41049 req_id = 494db5a4-a9f5-43f2-bb16-88e36a966f9a response_code = 200 uri = /network-bootstore-config
27022024-12-20T21:22:27.245ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27032024-12-20T21:22:27.245ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4d0b1b25-4a74-46a6-945f-18014df947c1
27042024-12-20T21:22:27.267ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27052024-12-20T21:22:27.267ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2
27062024-12-20T21:22:27.288ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27072024-12-20T21:22:27.288ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94
27082024-12-20T21:22:27.310ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27092024-12-20T21:22:27.310ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e
27102024-12-20T21:22:27.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248930 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50926 req_id = 147d42c9-8a7f-4926-b9de-0cfae6f4b4df response_code = 200 uri = /inventory
27112024-12-20T21:22:32.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64042
27122024-12-20T21:22:32.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64042 req_id = 86882273-58e3-47ac-b40a-d668d9eb2edd response_code = 200 uri = /vpc-routes
27132024-12-20T21:22:32.753ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
27142024-12-20T21:22:32.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64042 req_id = c3edfb4e-a4d7-4185-b761-16c30e3c0167 response_code = 204 uri = /eip-gateways
27152024-12-20T21:22:32.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64042 req_id = 252c0e27-88df-49a9-9bac-75c06a5e9135 response_code = 204 uri = /vpc-routes
27162024-12-20T21:22:32.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52205
27172024-12-20T21:22:32.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52205 req_id = 567dbffc-c566-41cf-b4e7-f15d1f4e5dc9 response_code = 200 uri = /v2p
27182024-12-20T21:22:32.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57455
27192024-12-20T21:22:32.964ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27202024-12-20T21:22:33.003ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27212024-12-20T21:22:33.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57455 req_id = 18f1a82f-eef0-4b77-b828-a3ea1de9de6e response_code = 204 uri = /switch-ports
27222024-12-20T21:22:33.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38064
27232024-12-20T21:22:33.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61245
27242024-12-20T21:22:33.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57455 req_id = bea09f0d-dd9a-41df-88cb-472dbcac3f38 response_code = 200 uri = /network-bootstore-config
27252024-12-20T21:22:33.059ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27262024-12-20T21:22:33.059ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27272024-12-20T21:22:33.059ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 98080c2a-60ac-4f19-9c61-1dba1075e7f1, kind: Service { id: 146c78a1-4090-415b-a726-0fab63981481 }, name: Name("external-dns-146c78a1-4090-415b-a726-0fab63981481"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 215])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f3a2d1ff-96f9-4033-ac12-e8b56b1f49bd, kind: Service { id: 3f3c284d-f6ea-4c08-b99f-d3400a604b35 }, name: Name("external-dns-3f3c284d-f6ea-4c08-b99f-d3400a604b35"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05558672-7e0d-4f52-9d3c-b722be8d28d4, kind: Service { id: 00388d64-9eba-4119-a557-78f9dac1d369 }, name: Name("nexus-00388d64-9eba-4119-a557-78f9dac1d369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 30c86470-4a09-4989-bca6-858980103068, kind: Service { id: 33a5393a-715c-43fb-8918-ce2bd8ffd497 }, name: Name("nexus-33a5393a-715c-43fb-8918-ce2bd8ffd497"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77c09c05-aacb-4b48-b7ef-bb0f75b831b4, kind: Service { id: 67b5dc40-b3bd-4c7c-8633-7b3021d837d2 }, name: Name("nexus-67b5dc40-b3bd-4c7c-8633-7b3021d837d2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27282024-12-20T21:22:33.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27292024-12-20T21:22:33.059ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c5b1517f-af84-4f35-9630-726554609cf4/config/omicron-zones.json file = common/src/ledger.rs:177
27302024-12-20T21:22:33.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27312024-12-20T21:22:33.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27322024-12-20T21:22:33.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27332024-12-20T21:22:33.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27342024-12-20T21:22:33.059ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27352024-12-20T21:22:33.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 489 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61245 req_id = fab0b510-83fc-43c3-ba04-d41011269c1d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27362024-12-20T21:22:33.059ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/config/omicron-zones.json file = common/src/ledger.rs:177
27372024-12-20T21:22:33.072ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6cbb0b58-4d44-45b0-895e-d80165779045 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27382024-12-20T21:22:33.072ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6cbb0b58-4d44-45b0-895e-d80165779045
27392024-12-20T21:22:33.094ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e5673e3a-b16a-4b87-bf2d-9759b56729e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27402024-12-20T21:22:33.095ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e5673e3a-b16a-4b87-bf2d-9759b56729e8
27412024-12-20T21:22:33.118ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 70bee423-c23a-4941-9c18-69f4feca1839 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27422024-12-20T21:22:33.118ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_70bee423-c23a-4941-9c18-69f4feca1839
27432024-12-20T21:22:33.139ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d53f565a-e812-4053-98b4-59c34d29e75c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27442024-12-20T21:22:33.139ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d53f565a-e812-4053-98b4-59c34d29e75c
27452024-12-20T21:22:33.160ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a16d1ab2-d6fe-4984-90b3-41981eabcf75 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27462024-12-20T21:22:33.160ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a16d1ab2-d6fe-4984-90b3-41981eabcf75
27472024-12-20T21:22:33.180ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d0b1b25-4a74-46a6-945f-18014df947c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27482024-12-20T21:22:33.180ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4d0b1b25-4a74-46a6-945f-18014df947c1
27492024-12-20T21:22:33.202ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9770094a-b7e6-4b9b-bf80-84437f05c6b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27502024-12-20T21:22:33.202ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9770094a-b7e6-4b9b-bf80-84437f05c6b2
27512024-12-20T21:22:33.222ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3aaf6321-1f78-413a-aeef-fc748a8d6f94 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27522024-12-20T21:22:33.222ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94
27532024-12-20T21:22:33.242ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27542024-12-20T21:22:33.242ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e
27552024-12-20T21:22:33.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195542 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38064 req_id = 3315e657-f8a4-4ee5-b261-c26e0d94e5aa response_code = 200 uri = /inventory
27562024-12-20T21:22:39.109ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7424 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 778917c3-e757-4d3b-a270-2bd867ca32c0 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
27572024-12-20T21:22:46.493ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54593
27582024-12-20T21:22:46.493ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54593 req_id = b01a758a-e84b-4c45-a5a5-a79ea92b3261 response_code = 200 uri = /baseboard
27592024-12-20T21:22:56.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63371
27602024-12-20T21:22:56.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63371 req_id = dbfd1ef7-0153-4c3b-a65f-2fb53f753b12 response_code = 200 uri = /vpc-routes
27612024-12-20T21:22:56.464ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
27622024-12-20T21:22:56.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63371 req_id = 8fd9ac26-0d60-4fb0-997b-effab6c1b544 response_code = 204 uri = /eip-gateways
27632024-12-20T21:22:56.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63371 req_id = ee3ffefd-17dd-4984-a81a-1df77d6b33bc response_code = 204 uri = /vpc-routes
27642024-12-20T21:22:56.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43723
27652024-12-20T21:22:56.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43723 req_id = 8fca2c6f-5740-424f-99cb-a5325d42415f response_code = 200 uri = /v2p
27662024-12-20T21:22:56.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36335
27672024-12-20T21:22:56.644ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27682024-12-20T21:22:56.681ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27692024-12-20T21:22:56.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90419 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36335 req_id = 0d08d352-8905-4fbf-97a4-b05c781c550b response_code = 204 uri = /switch-ports
27702024-12-20T21:22:56.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36335 req_id = 6ce5067c-11b4-4b52-a1a9-ba75d1df4d03 response_code = 200 uri = /network-bootstore-config
27712024-12-20T21:22:56.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41288
27722024-12-20T21:22:56.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41288 req_id = ba5433a2-2e59-4be8-a39e-ff94c57b5525 response_code = 200 uri = /vpc-routes
27732024-12-20T21:22:56.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
27742024-12-20T21:22:56.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41288 req_id = 68523efb-cbf5-4a9c-82ef-bc34f33435a9 response_code = 204 uri = /eip-gateways
27752024-12-20T21:22:56.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41288 req_id = a22f12c4-d9cf-41ce-82b7-b5149e76e334 response_code = 204 uri = /vpc-routes
27762024-12-20T21:22:56.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62745
27772024-12-20T21:22:56.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62745 req_id = 8e3c1c2f-100d-466a-873d-fbf8f0ffed51 response_code = 200 uri = /v2p
27782024-12-20T21:22:56.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52545
27792024-12-20T21:22:56.903ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27802024-12-20T21:22:56.941ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27812024-12-20T21:22:56.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91215 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52545 req_id = d6a40dda-0781-48bd-bba9-07965c369b00 response_code = 204 uri = /switch-ports
27822024-12-20T21:22:56.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52545 req_id = d095c67b-f4f6-4e16-9629-65e56a027873 response_code = 200 uri = /network-bootstore-config
27832024-12-20T21:23:02.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52387
27842024-12-20T21:23:02.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52387 req_id = eaf1b0bc-ab80-4c4e-95d8-49f4ddeefa02 response_code = 200 uri = /vpc-routes
27852024-12-20T21:23:02.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
27862024-12-20T21:23:02.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52387 req_id = bc25759e-8af4-4e1c-985e-67bba70356a1 response_code = 204 uri = /eip-gateways
27872024-12-20T21:23:02.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52387 req_id = eeacfc9e-c145-42b4-bebf-c4da9dd07d2d response_code = 204 uri = /vpc-routes
27882024-12-20T21:23:02.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47238
27892024-12-20T21:23:02.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47238 req_id = 9e534796-76be-40a2-820e-a2952cfc1ab0 response_code = 200 uri = /v2p
27902024-12-20T21:23:02.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50515
27912024-12-20T21:23:02.738ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27922024-12-20T21:23:02.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27932024-12-20T21:23:02.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94531 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50515 req_id = aef8725f-fdb8-4ee3-a3ad-de5fc7469f41 response_code = 204 uri = /switch-ports
27942024-12-20T21:23:02.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50515 req_id = 7b40ac18-0219-4747-97b7-c29ec0e20149 response_code = 200 uri = /network-bootstore-config
27952024-12-20T21:23:09.109ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7000 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 918fb460-8800-4783-89d1-eb349819632d response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
27962024-12-20T21:23:16.525ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61429
27972024-12-20T21:23:16.525ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61429 req_id = 23e62818-2103-4736-9e11-df69b8bf60a7 response_code = 200 uri = /baseboard
27982024-12-20T21:23:26.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51462
27992024-12-20T21:23:26.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51462 req_id = 279d03e7-822f-4b4a-b757-4b8b587a5847 response_code = 200 uri = /vpc-routes
28002024-12-20T21:23:26.678ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
28012024-12-20T21:23:26.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51462 req_id = 484c6230-7830-4a6b-9ce5-b8512863a639 response_code = 204 uri = /eip-gateways
28022024-12-20T21:23:26.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51462 req_id = 0cb19b17-94da-4399-81dd-4e9c0379f38b response_code = 204 uri = /vpc-routes
28032024-12-20T21:23:26.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40666
28042024-12-20T21:23:26.758ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28052024-12-20T21:23:26.796ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28062024-12-20T21:23:26.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40666 req_id = b25f59ce-a16f-4cc8-abc6-19321d51c786 response_code = 204 uri = /switch-ports
28072024-12-20T21:23:26.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56606
28082024-12-20T21:23:26.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40666 req_id = 4e551cb2-0eac-4439-9e09-24d4eba8a1b0 response_code = 200 uri = /network-bootstore-config
28092024-12-20T21:23:26.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56606 req_id = 844d95fe-757c-4de8-9c3e-e8cae757e8e5 response_code = 200 uri = /v2p
28102024-12-20T21:23:26.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37644
28112024-12-20T21:23:26.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37644 req_id = 267c6b8c-9b2b-4746-95be-f6902cbf5f4d response_code = 200 uri = /vpc-routes
28122024-12-20T21:23:26.933ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
28132024-12-20T21:23:26.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37644 req_id = 5d74f9f8-48a1-48c1-b754-efe7fe410f3f response_code = 204 uri = /eip-gateways
28142024-12-20T21:23:26.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37644 req_id = 5bdc43a5-0423-448d-8691-c13bac2d985a response_code = 204 uri = /vpc-routes
28152024-12-20T21:23:26.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64019
28162024-12-20T21:23:26.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64019 req_id = 389c37a9-4919-4642-a98e-31b8d17831c8 response_code = 200 uri = /v2p
28172024-12-20T21:23:26.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52052
28182024-12-20T21:23:26.998ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28192024-12-20T21:23:27.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28202024-12-20T21:23:27.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91928 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52052 req_id = 6102199a-05eb-422a-82ec-13f738b1b7e2 response_code = 204 uri = /switch-ports
28212024-12-20T21:23:27.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52052 req_id = 51f9e8b7-a196-47c7-8ac5-139aa13d265d response_code = 200 uri = /network-bootstore-config
28222024-12-20T21:23:32.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37428
28232024-12-20T21:23:32.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37428 req_id = bf340e7a-a914-4b53-b725-c20d714b3975 response_code = 200 uri = /vpc-routes
28242024-12-20T21:23:32.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
28252024-12-20T21:23:32.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37428 req_id = 84f9e69f-5956-4940-9787-49540b1c55c5 response_code = 204 uri = /eip-gateways
28262024-12-20T21:23:32.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37428 req_id = 58be7035-d51c-41a6-835d-f13801957616 response_code = 204 uri = /vpc-routes
28272024-12-20T21:23:33.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47998
28282024-12-20T21:23:33.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47998 req_id = 0582ccd0-4bae-4c48-83e2-98d1c3e4fd36 response_code = 200 uri = /v2p
28292024-12-20T21:23:33.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35812
28302024-12-20T21:23:33.060ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28312024-12-20T21:23:33.098ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28322024-12-20T21:23:33.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35812 req_id = 0d604075-92f4-4bda-b571-98d97014768e response_code = 204 uri = /switch-ports
28332024-12-20T21:23:33.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35812 req_id = 05582223-1909-4c83-94b8-51cfb2693257 response_code = 200 uri = /network-bootstore-config
28342024-12-20T21:23:39.109ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8298 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 9ec88e30-e1b3-4be1-95e5-daf1c40da978 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
28352024-12-20T21:23:46.557ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59004
28362024-12-20T21:23:46.557ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59004 req_id = 3a579839-4329-4d18-ba17-61317edd3e22 response_code = 200 uri = /baseboard
28372024-12-20T21:23:53.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62092
28382024-12-20T21:23:53.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62092 req_id = 929dcc97-8dd9-4925-9886-71f1245f33b6 response_code = 200 uri = /v2p
28392024-12-20T21:23:53.713ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(15023066) }
28402024-12-20T21:23:53.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 659 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62092 req_id = b0d1fc75-fe9e-4094-bdf0-3d8f755892ba response_code = 204 uri = /v2p
28412024-12-20T21:23:53.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40559
28422024-12-20T21:23:53.727ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 56285109-1ddf-4a28-b297-61c0f388bd89, kind: Instance { id: 05cc6283-851f-419b-b7f4-eae5d4207c76 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15023066), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 56285109-1ddf-4a28-b297-61c0f388bd89, kind: Instance { id: 05cc6283-851f-419b-b7f4-eae5d4207c76 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15023066), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 56285109-1ddf-4a28-b297-61c0f388bd89, kind: Instance { id: 05cc6283-851f-419b-b7f4-eae5d4207c76 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15023066), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15023066))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 56285109-1ddf-4a28-b297-61c0f388bd89, kind: Instance { id: 05cc6283-851f-419b-b7f4-eae5d4207c76 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15023066), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-5e6eeaa0c6f", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 06202b9b-b0aa-49fd-8ae5-61be81e96af6, read_only_parent: Some(Volume { block_size: 512, id: 420d896a-321f-41f5-a704-07710937bcfa, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 01dc5d48-5bcd-4f52-a55d-b6b14502586d, key: Some("wWb6t9zYTzMAbExvjwM+rDlcSMd7me6r3KUVSyy4k5c="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::15]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 06202b9b-b0aa-49fd-8ae5-61be81e96af6, key: Some("2utNu/mH24FuBNYY25ocr/Z7eSYC2x4JR7w+i19wp1s="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19003", "[fd00:1122:3344:101::17]:19000", "[fd00:1122:3344:101::16]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-5e6eeaa0c6f" }] }), cloud_init_bytes: Some(..) } instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 metadata = InstanceMetadata { silo_id: 3c88a481-e66b-4345-a953-f31532316b0e, project_id: 675af7c8-c218-437b-b03e-afef01a57178 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-20T21:23:53.719939631Z }
28432024-12-20T21:23:53.727ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 migration_id = None propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28442024-12-20T21:23:53.728ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 migration_id = None propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 56285109-1ddf-4a28-b297-61c0f388bd89, kind: Instance { id: 05cc6283-851f-419b-b7f4-eae5d4207c76 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15023066), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 56285109-1ddf-4a28-b297-61c0f388bd89, kind: Instance { id: 05cc6283-851f-419b-b7f4-eae5d4207c76 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15023066), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 56285109-1ddf-4a28-b297-61c0f388bd89, kind: Instance { id: 05cc6283-851f-419b-b7f4-eae5d4207c76 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15023066), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15023066))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 56285109-1ddf-4a28-b297-61c0f388bd89, kind: Instance { id: 05cc6283-851f-419b-b7f4-eae5d4207c76 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15023066), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-5e6eeaa0c6f", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 06202b9b-b0aa-49fd-8ae5-61be81e96af6, read_only_parent: Some(Volume { block_size: 512, id: 420d896a-321f-41f5-a704-07710937bcfa, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 01dc5d48-5bcd-4f52-a55d-b6b14502586d, key: Some("wWb6t9zYTzMAbExvjwM+rDlcSMd7me6r3KUVSyy4k5c="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::15]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 06202b9b-b0aa-49fd-8ae5-61be81e96af6, key: Some("2utNu/mH24FuBNYY25ocr/Z7eSYC2x4JR7w+i19wp1s="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19003", "[fd00:1122:3344:101::17]:19000", "[fd00:1122:3344:101::16]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-5e6eeaa0c6f" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-20T21:23:53.719939631Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28452024-12-20T21:23:53.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9667 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40559 req_id = 0c07b77f-a149-46a9-a880-105ced5fb6df response_code = 200 uri = /vmms/4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28462024-12-20T21:23:53.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55323
28472024-12-20T21:23:53.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2587 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55323 req_id = 56f0480a-492e-4426-bbcd-5941b542aff7 response_code = 200 uri = /vmms/4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6/state
28482024-12-20T21:23:53.845ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 15023066 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28492024-12-20T21:23:53.845ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28502024-12-20T21:23:53.885ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 file = illumos-utils/src/zone.rs:325 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28512024-12-20T21:23:53.906ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 file = illumos-utils/src/zone.rs:363 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28522024-12-20T21:23:53.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48931
28532024-12-20T21:23:53.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48931 req_id = fbb81793-b5e9-477d-af5e-7bd25250b260 response_code = 200 uri = /vpc-routes
28542024-12-20T21:23:53.998ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {56285109-1ddf-4a28-b297-61c0f388bd89: {10.151.2.176: {09a2239f-51fa-4825-b073-96a453029355}, 10.151.2.175: {09a2239f-51fa-4825-b073-96a453029355}}} }
28552024-12-20T21:23:55.283ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28562024-12-20T21:23:55.283ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28572024-12-20T21:23:55.450ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 71.405219ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28582024-12-20T21:23:55.540ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 58.085496ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28592024-12-20T21:23:55.612ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 225.829318ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28602024-12-20T21:23:55.855ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 370.584887ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28612024-12-20T21:23:56.236ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 414.358444ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28622024-12-20T21:23:56.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37426
28632024-12-20T21:23:56.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35144
28642024-12-20T21:23:56.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35144 req_id = edb1df7b-aed0-475e-b896-b0635a3d2f03 response_code = 200 uri = /v2p
28652024-12-20T21:23:56.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49958
28662024-12-20T21:23:56.632ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28672024-12-20T21:23:56.681ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28682024-12-20T21:23:56.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102446 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49958 req_id = 03796744-dea5-47bb-ad7b-dc18f829aa60 response_code = 204 uri = /switch-ports
28692024-12-20T21:23:56.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49958 req_id = 36148887-6f90-4c94-b165-43994c69cfa8 response_code = 200 uri = /network-bootstore-config
28702024-12-20T21:23:56.747ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 681.869955ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28712024-12-20T21:23:56.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36934
28722024-12-20T21:23:56.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61002
28732024-12-20T21:23:56.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61002 req_id = cb89e5c2-c95b-4035-889a-49f50fe1531d response_code = 200 uri = /vpc-routes
28742024-12-20T21:23:56.921ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {56285109-1ddf-4a28-b297-61c0f388bd89: {10.151.2.175: {09a2239f-51fa-4825-b073-96a453029355}, 10.151.2.176: {09a2239f-51fa-4825-b073-96a453029355}}} }
28752024-12-20T21:23:56.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61002 req_id = 69fe99cb-fd7e-45fb-9ed4-02dd13c9a069 response_code = 204 uri = /eip-gateways
28762024-12-20T21:23:56.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39381
28772024-12-20T21:23:56.962ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28782024-12-20T21:23:57.001ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28792024-12-20T21:23:57.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101144 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39381 req_id = 140d7fea-3756-48c4-a28f-ad62c1ee50c6 response_code = 204 uri = /switch-ports
28802024-12-20T21:23:57.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33998
28812024-12-20T21:23:57.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39381 req_id = f52e763b-85fd-429f-ba7a-619c7c5b5963 response_code = 200 uri = /network-bootstore-config
28822024-12-20T21:23:57.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33998 req_id = 2097c657-94c3-4e3a-a6e5-f69f588bcb83 response_code = 200 uri = /v2p
28832024-12-20T21:23:57.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 436 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61002 req_id = e16251c5-c238-4f90-baf6-d04a6704b74d response_code = 204 uri = /vpc-routes
28842024-12-20T21:23:57.441ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 615.907041ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28852024-12-20T21:23:58.068ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 1.072238857s file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28862024-12-20T21:23:59.152ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 531.758774ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28872024-12-20T21:23:59.695ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 537.015595ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 zone = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28882024-12-20T21:24:00.262ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 file = sled-agent/src/instance.rs:1786 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28892024-12-20T21:24:00.271ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 51.356015ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28902024-12-20T21:24:00.332ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 147.482282ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28912024-12-20T21:24:00.490ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 150.695581ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28922024-12-20T21:24:00.652ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6") failed: Property not found. retry in 507.214903ms file = illumos-utils/src/svc.rs:36 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28932024-12-20T21:24:01.171ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28942024-12-20T21:24:01.208ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28952024-12-20T21:24:01.347ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
28962024-12-20T21:24:01.348ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
28972024-12-20T21:24:01.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4458380 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36934 req_id = ee9965b2-3761-46f5-a38a-655805ef1306 response_code = 200 uri = /vmms/4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6/state
28982024-12-20T21:24:01.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4851967 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37426 req_id = c650af34-3ded-4dbd-bd5f-13a56cef9c0c response_code = 200 uri = /vmms/4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6/state
28992024-12-20T21:24:01.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7349854 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48931 req_id = 03e5f699-cb72-4b4f-8325-3d2c08d43598 response_code = 204 uri = /eip-gateways
29002024-12-20T21:24:01.348ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-20T21:24:01.348783143Z } file = sled-agent/src/instance.rs:780 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29012024-12-20T21:24:01.348ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-20T21:24:01.348783143Z } propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29022024-12-20T21:24:01.348ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-20T21:24:01.348783143Z }, migration_in: None, migration_out: None }
29032024-12-20T21:24:01.396ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-20T21:24:01.396650961Z } file = sled-agent/src/instance.rs:780 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29042024-12-20T21:24:01.396ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T21:24:01.396650961Z } propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29052024-12-20T21:24:01.396ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T21:24:01.396650961Z }, migration_in: None, migration_out: None }
29062024-12-20T21:24:01.485ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: f233084e-0c49-4720-a96f-39965ff9070e, version: 3 } old_vers = RouterVersion { router_id: f233084e-0c49-4720-a96f-39965ff9070e, version: 3 } subnet = RouterId { vni: Vni(15023066), kind: System }
29072024-12-20T21:24:01.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48931 req_id = dde3feb4-3c65-453f-b3b9-70a18e216443 response_code = 204 uri = /vpc-routes
29082024-12-20T21:24:01.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47743
29092024-12-20T21:24:01.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 76e50eed-0e11-4d92-a72d-aed1fdbdb4b1 response_code = 200 uri = /vpc-routes
29102024-12-20T21:24:01.624ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {56285109-1ddf-4a28-b297-61c0f388bd89: {10.151.2.175: {09a2239f-51fa-4825-b073-96a453029355}, 10.151.2.176: {09a2239f-51fa-4825-b073-96a453029355}}} }
29112024-12-20T21:24:01.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 251aecc1-cd70-4369-a6e5-22058df0f202 response_code = 204 uri = /eip-gateways
29122024-12-20T21:24:01.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 049a9b27-8157-445f-aaec-7a63f42efb7a response_code = 204 uri = /vpc-routes
29132024-12-20T21:24:02.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45152
29142024-12-20T21:24:02.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45152 req_id = 22600b02-12c4-4be5-87d8-aaa9ca30ede8 response_code = 200 uri = /vmms/4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6/state
29152024-12-20T21:24:02.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32812
29162024-12-20T21:24:02.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32812 req_id = 9ea64f18-04e5-46a3-881d-a17b469516ff response_code = 200 uri = /vpc-routes
29172024-12-20T21:24:02.724ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {56285109-1ddf-4a28-b297-61c0f388bd89: {10.151.2.175: {09a2239f-51fa-4825-b073-96a453029355}, 10.151.2.176: {09a2239f-51fa-4825-b073-96a453029355}}} }
29182024-12-20T21:24:02.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32812 req_id = fc267746-eb24-4772-aafb-ae2a09d99c47 response_code = 204 uri = /eip-gateways
29192024-12-20T21:24:02.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65442
29202024-12-20T21:24:02.737ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29212024-12-20T21:24:02.777ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29222024-12-20T21:24:02.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65442 req_id = deedec84-665c-447b-be9b-5037b28d8c22 response_code = 204 uri = /switch-ports
29232024-12-20T21:24:02.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46576
29242024-12-20T21:24:02.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46576 req_id = f30fbf92-d68f-4a19-a7c1-581f9c70f042 response_code = 200 uri = /v2p
29252024-12-20T21:24:02.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65442 req_id = e4212953-cd82-4949-a62f-f1accb56b01c response_code = 200 uri = /network-bootstore-config
29262024-12-20T21:24:02.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32812 req_id = bb43b0d2-6e20-41b5-b50d-d12d52a7b295 response_code = 204 uri = /vpc-routes
29272024-12-20T21:24:09.108ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6989 local_addr = [fd00:1122:3344:101::1]:64338 method = GET remote_addr = [fd00:1122:3344:101::d]:49038 req_id = 79f37c44-2de3-43a3-aaf9-88a107679532 response_code = 200 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 uri = /9ab49b39-4891-4f63-9152-18cfc9c75d04
29282024-12-20T21:24:11.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32895
29292024-12-20T21:24:11.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 553 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32895 req_id = a5166584-fec9-4dd2-90a1-5c1340295e24 response_code = 200 uri = /vmms/4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6/state
29302024-12-20T21:24:11.561ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-20T21:24:11.561925500Z } file = sled-agent/src/instance.rs:780 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29312024-12-20T21:24:11.561ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-20T21:24:11.561925500Z } propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29322024-12-20T21:24:11.561ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-20T21:24:11.561925500Z }, migration_in: None, migration_out: None }
29332024-12-20T21:24:11.606ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-20T21:24:11.606839971Z } file = sled-agent/src/instance.rs:780 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29342024-12-20T21:24:11.606ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-20T21:24:11.606839971Z } propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29352024-12-20T21:24:11.606ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29362024-12-20T21:24:11.606ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29372024-12-20T21:24:11.607ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 14720664304254061369 n_samples = 6 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
29382024-12-20T21:24:11.607ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 6563117711210388098 n_samples = 6 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
29392024-12-20T21:24:11.607ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29402024-12-20T21:24:11.607ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/70a61009-8fd6-48ae-91bd-7281148cd83a/debug/bundle/zone", "/pool/int/c5b1517f-af84-4f35-9630-726554609cf4/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/6cbb0b58-4d44-45b0-895e-d80165779045/crypt/debug", "/pool/ext/e5673e3a-b16a-4b87-bf2d-9759b56729e8/crypt/debug", "/pool/ext/70bee423-c23a-4941-9c18-69f4feca1839/crypt/debug", "/pool/ext/d53f565a-e812-4053-98b4-59c34d29e75c/crypt/debug", "/pool/ext/a16d1ab2-d6fe-4984-90b3-41981eabcf75/crypt/debug", "/pool/ext/4d0b1b25-4a74-46a6-945f-18014df947c1/crypt/debug", "/pool/ext/9770094a-b7e6-4b9b-bf80-84437f05c6b2/crypt/debug", "/pool/ext/3aaf6321-1f78-413a-aeef-fc748a8d6f94/crypt/debug", "/pool/ext/f41dfcfa-28bb-46e5-b5a6-1b1b6ed8053e/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29412024-12-20T21:24:12.229ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6", bundle_id: 5bdd486c-1d96-4132-a150-2a841dc6f301 }, time_created: 2024-12-20T21:24:11.607792700Z, version: 0, cause: TerminatedInstance }
29422024-12-20T21:24:12.229ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 file = sled-agent/src/instance.rs:1032 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29432024-12-20T21:24:13.965ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29442024-12-20T21:24:13.982ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(15023066), kind: System }
29452024-12-20T21:24:13.982ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(15023066), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29462024-12-20T21:24:13.982ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T21:24:13.982754062Z }, migration_in: None, migration_out: None }
29472024-12-20T21:24:14.005ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T21:24:13.982754062Z }, migration_in: None, migration_out: None }
29482024-12-20T21:24:14.010ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 05cc6283-851f-419b-b7f4-eae5d4207c76 propolis_id = 4a927f6a-8fb0-4b8f-b126-1506c1bdd0c6
29492024-12-20T21:24:14.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64250
29502024-12-20T21:24:14.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64250 req_id = 7e2f004a-d317-4d45-aea2-2ee97b9bc813 response_code = 200 uri = /vpc-routes
29512024-12-20T21:24:14.467ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {56285109-1ddf-4a28-b297-61c0f388bd89: {10.151.2.176: {09a2239f-51fa-4825-b073-96a453029355}, 10.151.2.175: {09a2239f-51fa-4825-b073-96a453029355}}} }
29522024-12-20T21:24:14.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64250 req_id = 8cb133c6-608f-4a37-8be8-6d831f6c4880 response_code = 204 uri = /eip-gateways
29532024-12-20T21:24:14.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64250 req_id = 0c4be147-d69d-4665-ab5e-253d66323f94 response_code = 204 uri = /vpc-routes
29542024-12-20T21:24:14.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42666
29552024-12-20T21:24:14.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42666 req_id = 67b83b3f-9a44-4c48-a53f-620907b5e48a response_code = 200 uri = /v2p
29562024-12-20T21:24:14.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51537
29572024-12-20T21:24:14.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51537 req_id = 0c90d443-0ebf-416b-b764-d6df05d617f0 response_code = 200 uri = /v2p
29582024-12-20T21:24:14.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47319
29592024-12-20T21:24:14.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47319 req_id = bda6e982-f779-45ae-9dc0-deb2891b6bfb response_code = 200 uri = /vpc-routes
29602024-12-20T21:24:14.995ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
29612024-12-20T21:24:14.995ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04
29622024-12-20T21:24:14.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47319 req_id = c7bd961e-9b0a-45cd-9595-140d1322352d response_code = 204 uri = /eip-gateways
29632024-12-20T21:24:15.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47319 req_id = f806c2ce-46ec-4a60-9978-505203caffdc response_code = 204 uri = /vpc-routes
29642024-12-20T21:24:15.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47765
29652024-12-20T21:24:15.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47765 req_id = af197a44-1f08-41a1-92ac-2f86462e9b4d response_code = 200 uri = /vpc-routes
29662024-12-20T21:24:15.637ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 9ab49b39-4891-4f63-9152-18cfc9c75d04 values = ExternalIpGatewayMap { mappings: {} }
29672024-12-20T21:24:15.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47765 req_id = daf9443d-de6b-46d4-a9fe-d51bb6191b3c response_code = 204 uri = /eip-gateways
29682024-12-20T21:24:15.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47765 req_id = d4799cfe-2355-4528-922f-4264fc2554ad response_code = 204 uri = /vpc-routes
29692024-12-20T21:24:16.590ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62869
29702024-12-20T21:24:16.590ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62869 req_id = 559aa4ef-4078-4342-8e4e-09419525b5ea response_code = 200 uri = /baseboard