Max level shown:
1 [ Dec 12 03:59:40 Enabled. ]
2 [ Dec 12 03:59:40 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 12 03:59:40 Method "start" exited with status 0. ]
4 [ Dec 12 03:59:40 Rereading configuration. ]
5 [ Dec 12 03:59:40 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-12T03:59:40.046ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-12T03:59:40.047ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-12T03:59:40.100ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-12T03:59:40.100ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-12T03:59:40.216ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-12T03:59:40.225ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-12T03:59:40.233ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-12T03:59:40.835ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-12-12T03:59:40.976ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-12T03:59:40.976ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-12T03:59:40.976ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-12T03:59:40.976ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
192024-12-12T03:59:40.976ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
202024-12-12T03:59:40.976ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-12T03:59:40.979ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-12T03:59:40.979ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-12T03:59:40.979ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-12T03:59:40.979ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-12T03:59:40.979ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-12T03:59:40.979ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-12T03:59:40.979ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-12-12T03:59:40.979ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-12T03:59:40.979ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-12T03:59:40.991ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-12T03:59:40.991ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool)
322024-12-12T03:59:41.090ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal }
332024-12-12T03:59:41.551ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-12-12T03:59:41.551ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-12T03:59:41.551ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-12T03:59:41.551ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-12T03:59:41.551ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-12-12T03:59:41.551ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-12T03:59:41.551ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-12T03:59:41.560ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-12T03:59:41.560ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool)
422024-12-12T03:59:41.648ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal }
432024-12-12T03:59:42.124ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-12T03:59:42.124ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-12T03:59:42.124ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-12-12T03:59:42.124ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-12T03:59:42.124ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-12T03:59:42.124ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-12T03:59:42.124ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-12-12T03:59:42.124ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-12T03:59:42.124ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-12T03:59:42.124ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-12-12T03:59:42.124ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
582024-12-12T03:59:42.124ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
592024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-12T03:59:42.124ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-12T03:59:42.124ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-12T03:59:42.124ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
642024-12-12T03:59:42.124ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-12T03:59:42.124ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-12T03:59:42.124ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
692024-12-12T03:59:42.124ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702024-12-12T03:59:42.124ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
712024-12-12T03:59:42.124ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
722024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
732024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
742024-12-12T03:59:42.124ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
752024-12-12T03:59:42.124ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-12-12T03:59:42.124ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792024-12-12T03:59:42.124ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-12T03:59:42.124ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-12-12T03:59:42.124ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822024-12-12T03:59:42.124ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
832024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-12-12T03:59:42.124ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-12T03:59:42.124ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-12-12T03:59:42.124ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-12T03:59:42.124ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-12T03:59:42.124ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-12T03:59:42.124ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-12-12T03:59:42.124ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-12T03:59:42.124ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-12T03:59:42.124ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-12T03:59:42.124ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-12T03:59:42.124ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-12T03:59:42.124ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1012024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-12-12T03:59:42.124ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-12-12T03:59:42.124ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-12T03:59:42.124ZINFOSledAgent (bootstore): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-12-12T03:59:42.124ZINFOSledAgent (bootstore): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-12-12T03:59:42.124ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-12-12T03:59:42.124ZINFOSledAgent (bootstore): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-12-12T03:59:42.124ZINFOSledAgent (bootstore): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-12-12T03:59:42.124ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-12-12T03:59:42.124ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-12T03:59:42.124ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-12T03:59:42.136ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132024-12-12T03:59:42.136ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 4014, tv_nsec: 235399087 } time_to_next_cleanup = 599.999928218s
1142024-12-12T03:59:42.136ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1152024-12-12T03:59:42.136ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-12-12T03:59:42.138ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-12T03:59:42.139ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-12T03:59:42.139ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-12-12T03:59:42.141ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-12-12T03:59:42.142ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1187
1212024-12-12T03:59:42.142ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-12T03:59:42.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-12-12T03:59:42.142ZINFOSledAgent (RSS): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-12-12T03:59:42.142ZINFOSledAgent (RSS): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-12-12T03:59:42.142ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1250
1262024-12-12T03:59:42.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-12-12T03:59:42.142ZINFOSledAgent (RSS): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-12-12T03:59:42.142ZINFOSledAgent (RSS): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-12-12T03:59:42.142ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1292
1302024-12-12T03:59:42.142ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-12-12T03:59:42.142ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-12-12T03:59:42.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-12-12T03:59:42.142ZINFOSledAgent (RSS): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-12-12T03:59:42.142ZINFOSledAgent (RSS): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-12-12T03:59:42.143ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 80af691a-30bb-4399-8524-a68071b516df (sled), rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-12-12T03:59:42.143ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1326
1372024-12-12T03:59:42.143ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-12-12T03:59:42.143ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-12-12T03:59:42.143ZINFOSledAgent (bootstore): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-12-12T03:59:42.143ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-12-12T03:59:42.143ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 80af691a-30bb-4399-8524-a68071b516df (sled), rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-12-12T03:59:42.143ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1432024-12-12T03:59:42.143ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1442024-12-12T03:59:42.148ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-12-12T03:59:42.155ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-12T03:59:42.155ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-12T03:59:42.159ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-12-12T03:59:42.159ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-12-12T03:59:42.159ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:33116
1502024-12-12T03:59:42.159ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 80af691a-30bb-4399-8524-a68071b516df (sled), rack_id: 1612ec8d-a72c-445a-999f-274daa8c155e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-12-12T03:59:42.159ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-12-12T03:59:42.159ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-12-12T03:59:42.159ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-12-12T03:59:42.159ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-12-12T03:59:42.159ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-12-12T03:59:42.159ZINFOSledAgent (StorageManager): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-12T03:59:42.159ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1582024-12-12T03:59:42.159ZINFOSledAgent (StorageManager): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-12-12T03:59:42.159ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-12-12T03:59:42.159ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-12-12T03:59:42.159ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-12-12T03:59:42.159ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-12-12T03:59:42.159ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-12-12T03:59:42.176ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-12-12T03:59:42.198ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-12-12T03:59:42.216ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-12-12T03:59:42.244ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = 80af691a-30bb-4399-8524-a68071b516df
1682024-12-12T03:59:42.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-12-12T03:59:42.245ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = 80af691a-30bb-4399-8524-a68071b516df
1702024-12-12T03:59:42.245ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-12-12T03:59:42.248ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 77.003258ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f65671dc-2565-499d-9658-086476be6e70", "content-length": "124", "date": "Thu, 12 Dec 2024 03:59:42 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f65671dc-2565-499d-9658-086476be6e70" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-12-12T03:59:42.258ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_c1febdee-2c98-4f12-9aa4-ad18d04436bd/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-12-12T03:59:42.281ZINFOSledAgent: successfully created encrypted zvol: name="oxi_c1febdee-2c98-4f12-9aa4-ad18d04436bd/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-12-12T03:59:42.281ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_c1febdee-2c98-4f12-9aa4-ad18d04436bd/swap" file = sled-agent/src/swap_device.rs:96
1752024-12-12T03:59:42.287ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = 80af691a-30bb-4399-8524-a68071b516df
1762024-12-12T03:59:42.287ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-12-12T03:59:42.287ZINFOSledAgent (BackingFs): Ensuring dataset oxi_c1febdee-2c98-4f12-9aa4-ad18d04436bd/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-12-12T03:59:42.325ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-12-12T03:59:42.326ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 81.904231ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5227c026-8af4-4eeb-a2c9-a766eb823624", "content-length": "124", "date": "Thu, 12 Dec 2024 03:59:42 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5227c026-8af4-4eeb-a2c9-a766eb823624" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-12-12T03:59:42.367ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-12-12T03:59:42.409ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-12-12T03:59:42.409ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 154.488197ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0ef155e5-0a63-4be0-b2c2-649d864119c5", "content-length": "124", "date": "Thu, 12 Dec 2024 03:59:42 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0ef155e5-0a63-4be0-b2c2-649d864119c5" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-12-12T03:59:42.564ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-12-12T03:59:42.565ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 173.22623ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "58282395-013c-4453-815c-dbd4e907ade8", "content-length": "124", "date": "Thu, 12 Dec 2024 03:59:42 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "58282395-013c-4453-815c-dbd4e907ade8" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-12-12T03:59:42.586ZINFOSledAgent (BackingFs): Mounting oxi_c1febdee-2c98-4f12-9aa4-ad18d04436bd/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1862024-12-12T03:59:42.599ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1872024-12-12T03:59:42.599ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1882024-12-12T03:59:42.599ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1892024-12-12T03:59:42.599ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1902024-12-12T03:59:42.738ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-12T03:59:42.739ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 195.844416ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e9242ef3-26ca-46ab-8626-bca3acae3d8c", "content-length": "124", "date": "Thu, 12 Dec 2024 03:59:42 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e9242ef3-26ca-46ab-8626-bca3acae3d8c" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-12T03:59:42.935ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-12T03:59:42.936ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 323.902449ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8648a47b-c689-41cf-a22d-e8ea3b013d10", "content-length": "124", "date": "Thu, 12 Dec 2024 03:59:42 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8648a47b-c689-41cf-a22d-e8ea3b013d10" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-12-12T03:59:43.261ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-12-12T03:59:43.262ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 248.403454ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3ea553fb-81d8-43a3-8107-1daf9e387e30", "content-length": "124", "date": "Thu, 12 Dec 2024 03:59:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3ea553fb-81d8-43a3-8107-1daf9e387e30" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-12-12T03:59:43.345ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 80af691a-30bb-4399-8524-a68071b516df
1972024-12-12T03:59:43.350ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:43012 sled_id = 80af691a-30bb-4399-8524-a68071b516df
1982024-12-12T03:59:43.350ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 80af691a-30bb-4399-8524-a68071b516df
1992024-12-12T03:59:43.350ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:43012 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 80af691a-30bb-4399-8524-a68071b516df sled_id = 80af691a-30bb-4399-8524-a68071b516df
2002024-12-12T03:59:43.352ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 327.923443ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2012024-12-12T03:59:43.353ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2022024-12-12T03:59:43.353ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2032024-12-12T03:59:43.353ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2042024-12-12T03:59:43.353ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-12-12T03:59:43.512ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-12-12T03:59:43.681ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 335.272961ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2072024-12-12T03:59:44.018ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 550.01632ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2082024-12-12T03:59:44.570ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.002675928s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2092024-12-12T03:59:45.574ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.033375895s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2102024-12-12T03:59:45.965ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2112024-12-12T03:59:45.965ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2122024-12-12T03:59:45.965ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2132024-12-12T03:59:45.965ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2142024-12-12T03:59:45.965ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2152024-12-12T03:59:45.965ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2162024-12-12T03:59:45.967ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2172024-12-12T03:59:45.968ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2182024-12-12T03:59:45.968ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='3b2db726-04e3-4c62-b925-c2dead0b14b8'/> <propval type="astring" name="rack_id" value='1612ec8d-a72c-445a-999f-274daa8c155e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fee8:b2c3'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='1612ec8d-a72c-445a-999f-274daa8c155e'/> <propval type="astring" name="sled_id" value='80af691a-30bb-4399-8524-a68071b516df'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='80af691a-30bb-4399-8524-a68071b516df'/> <propval type="astring" name="rack_uuid" value='1612ec8d-a72c-445a-999f-274daa8c155e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='80af691a-30bb-4399-8524-a68071b516df'/> <propval type="astring" name="rack_uuid" value='1612ec8d-a72c-445a-999f-274daa8c155e'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2192024-12-12T03:59:45.969ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2202024-12-12T03:59:46.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 29.668987ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-12T03:59:46.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 59.516863ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-12T03:59:46.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 176.536904ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-12T03:59:47.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 542.650442ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-12T03:59:47.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.064059272s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-12T03:59:48.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.24650912s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-12T03:59:49.610ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.288644293s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2272024-12-12T03:59:50.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 753.850066ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-12-12T03:59:51.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.007492396s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-12-12T03:59:52.537ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/nexus.rs:527 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2302024-12-12T03:59:52.568ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2312024-12-12T03:59:52.568ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2322024-12-12T03:59:52.570ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2332024-12-12T03:59:52.570ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2342024-12-12T03:59:52.570ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2352024-12-12T03:59:52.570ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-12-12T03:59:52.570ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-12-12T03:59:52.570ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2382024-12-12T03:59:52.570ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2392024-12-12T03:59:52.570ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2402024-12-12T03:59:52.570ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:33116
2412024-12-12T03:59:52.784ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2422024-12-12T03:59:52.784ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2432024-12-12T03:59:52.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2442024-12-12T03:59:52.784ZINFOSledAgent (RSS): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-12-12T03:59:52.784ZINFOSledAgent (RSS): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-12-12T03:59:52.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-12-12T03:59:52.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-12-12T03:59:52.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-12-12T03:59:52.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-12-12T03:59:52.790ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2512024-12-12T03:59:52.790ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2522024-12-12T03:59:52.790ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2532024-12-12T03:59:53.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47273
2542024-12-12T03:59:53.046ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-12-12T03:59:53.046ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-12-12T03:59:53.046ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-12-12T03:59:53.046ZINFOSledAgent (ServiceManager): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-12-12T03:59:53.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47273 req_id = 2c2e39ff-6e40-4f8a-9abe-c22d4308f648 response_code = 200 uri = /inventory
2592024-12-12T03:59:53.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48083
2602024-12-12T03:59:53.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48083 req_id = ce69bbce-4e39-4eeb-8faa-1e818ae4de4e response_code = 200 uri = /sled-role
2612024-12-12T03:59:53.078ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2622024-12-12T03:59:53.078ZINFOSledAgent (RSS): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-12-12T03:59:53.079ZINFOSledAgent (RSS): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-12-12T03:59:53.079ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:982
2652024-12-12T03:59:53.109ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 8ef580f0-9237-4772-93c1-a7b7ff157616 (physical_disk), pool_id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e0270969-aaea-48d1-8a64-28f655009465 (physical_disk), pool_id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 5ca7c739-57e4-4d40-927a-edd5aab37f16 (physical_disk), pool_id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 32593535-a85c-4ed6-9290-4a3a3a554e4b (physical_disk), pool_id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 90b13f79-64a7-4691-88e8-98f41ad4cb29 (physical_disk), pool_id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d92f2842-5287-4dbc-b0ba-5682dabdca4b (physical_disk), pool_id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 953f41f0-6743-45c2-b141-08289ff833ad (physical_disk), pool_id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 9b483aee-3427-4fc3-bb3c-d651bb3ec739 (physical_disk), pool_id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: bf5fcd36-ef47-4fde-a0b0-9842d9e81378 (physical_disk), pool_id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:369 sled_address = [fd00:1122:3344:101::1]:12345
2662024-12-12T03:59:53.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58734
2672024-12-12T03:59:53.109ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2682024-12-12T03:59:53.109ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 8ef580f0-9237-4772-93c1-a7b7ff157616 (physical_disk), pool_id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e0270969-aaea-48d1-8a64-28f655009465 (physical_disk), pool_id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 5ca7c739-57e4-4d40-927a-edd5aab37f16 (physical_disk), pool_id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 32593535-a85c-4ed6-9290-4a3a3a554e4b (physical_disk), pool_id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 90b13f79-64a7-4691-88e8-98f41ad4cb29 (physical_disk), pool_id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d92f2842-5287-4dbc-b0ba-5682dabdca4b (physical_disk), pool_id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 953f41f0-6743-45c2-b141-08289ff833ad (physical_disk), pool_id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 9b483aee-3427-4fc3-bb3c-d651bb3ec739 (physical_disk), pool_id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: bf5fcd36-ef47-4fde-a0b0-9842d9e81378 (physical_disk), pool_id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2692024-12-12T03:59:53.109ZINFOSledAgent (StorageManager): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-12-12T03:59:53.109ZINFOSledAgent (StorageManager): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-12-12T03:59:53.109ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2722024-12-12T03:59:53.109ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2732024-12-12T03:59:53.109ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2742024-12-12T03:59:53.109ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2752024-12-12T03:59:53.109ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2762024-12-12T03:59:53.268ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2772024-12-12T03:59:53.268ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool)
2782024-12-12T03:59:53.469ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2792024-12-12T03:59:53.471ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2802024-12-12T03:59:53.471ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2812024-12-12T03:59:53.568ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }
2822024-12-12T03:59:53.572ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
2832024-12-12T03:59:53.576ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2842024-12-12T03:59:53.576ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2852024-12-12T03:59:53.576ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2862024-12-12T03:59:53.576ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2872024-12-12T03:59:53.576ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-12-12T03:59:53.576ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-12-12T03:59:53.576ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2902024-12-12T03:59:53.614ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-12-12T03:59:53.622ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone file = sled-storage/src/dataset.rs:303
2922024-12-12T03:59:53.797ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071 file = sled-storage/src/dataset.rs:389
2932024-12-12T03:59:53.805ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2942024-12-12T03:59:53.805ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2952024-12-12T03:59:53.805ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2962024-12-12T03:59:53.805ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2972024-12-12T03:59:53.805ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2982024-12-12T03:59:53.815ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2992024-12-12T03:59:53.815ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool)
3002024-12-12T03:59:53.911ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }
3012024-12-12T03:59:53.920ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3022024-12-12T03:59:53.920ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3032024-12-12T03:59:53.920ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3042024-12-12T03:59:53.920ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3052024-12-12T03:59:53.920ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-12-12T03:59:53.920ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-12-12T03:59:53.920ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3082024-12-12T03:59:53.956ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3092024-12-12T03:59:53.963ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone file = sled-storage/src/dataset.rs:303
3102024-12-12T03:59:54.140ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46 file = sled-storage/src/dataset.rs:389
3112024-12-12T03:59:54.148ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3122024-12-12T03:59:54.148ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3132024-12-12T03:59:54.148ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3142024-12-12T03:59:54.148ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3152024-12-12T03:59:54.148ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3162024-12-12T03:59:54.158ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3172024-12-12T03:59:54.158ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool)
3182024-12-12T03:59:54.254ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }
3192024-12-12T03:59:54.262ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3202024-12-12T03:59:54.262ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3212024-12-12T03:59:54.262ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3222024-12-12T03:59:54.262ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3232024-12-12T03:59:54.262ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-12-12T03:59:54.262ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-12-12T03:59:54.262ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3262024-12-12T03:59:54.298ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3272024-12-12T03:59:54.306ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/zone file = sled-storage/src/dataset.rs:303
3282024-12-12T03:59:54.483ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb file = sled-storage/src/dataset.rs:389
3292024-12-12T03:59:54.492ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3302024-12-12T03:59:54.492ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3312024-12-12T03:59:54.492ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3322024-12-12T03:59:54.492ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3332024-12-12T03:59:54.492ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3342024-12-12T03:59:54.502ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3352024-12-12T03:59:54.502ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool)
3362024-12-12T03:59:54.595ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }
3372024-12-12T03:59:54.602ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3382024-12-12T03:59:54.602ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3392024-12-12T03:59:54.602ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3402024-12-12T03:59:54.602ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3412024-12-12T03:59:54.602ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3422024-12-12T03:59:54.602ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-12-12T03:59:54.602ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3442024-12-12T03:59:54.605ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
3452024-12-12T03:59:54.638ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3462024-12-12T03:59:54.646ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/zone file = sled-storage/src/dataset.rs:303
3472024-12-12T03:59:54.823ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47 file = sled-storage/src/dataset.rs:389
3482024-12-12T03:59:54.831ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3492024-12-12T03:59:54.831ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3502024-12-12T03:59:54.831ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3512024-12-12T03:59:54.831ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3522024-12-12T03:59:54.831ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3532024-12-12T03:59:54.842ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3542024-12-12T03:59:54.842ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool)
3552024-12-12T03:59:54.941ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }
3562024-12-12T03:59:54.949ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3572024-12-12T03:59:54.949ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3582024-12-12T03:59:54.949ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3592024-12-12T03:59:54.949ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3602024-12-12T03:59:54.949ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-12-12T03:59:54.949ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-12-12T03:59:54.949ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3632024-12-12T03:59:54.984ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3642024-12-12T03:59:54.993ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/zone file = sled-storage/src/dataset.rs:303
3652024-12-12T03:59:55.173ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4 file = sled-storage/src/dataset.rs:389
3662024-12-12T03:59:55.181ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3672024-12-12T03:59:55.181ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3682024-12-12T03:59:55.181ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3692024-12-12T03:59:55.181ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3702024-12-12T03:59:55.181ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3712024-12-12T03:59:55.191ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3722024-12-12T03:59:55.191ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool)
3732024-12-12T03:59:55.290ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }
3742024-12-12T03:59:55.298ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3752024-12-12T03:59:55.298ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3762024-12-12T03:59:55.298ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3772024-12-12T03:59:55.298ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3782024-12-12T03:59:55.298ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3792024-12-12T03:59:55.298ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-12-12T03:59:55.298ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3812024-12-12T03:59:55.336ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3822024-12-12T03:59:55.343ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/zone file = sled-storage/src/dataset.rs:303
3832024-12-12T03:59:55.522ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4b8ca783-c0e0-4c3f-a149-be038075af29 file = sled-storage/src/dataset.rs:389
3842024-12-12T03:59:55.530ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3852024-12-12T03:59:55.530ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3862024-12-12T03:59:55.530ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3872024-12-12T03:59:55.530ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3882024-12-12T03:59:55.530ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3892024-12-12T03:59:55.540ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3902024-12-12T03:59:55.540ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool)
3912024-12-12T03:59:55.637ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }
3922024-12-12T03:59:55.645ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3932024-12-12T03:59:55.645ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3942024-12-12T03:59:55.645ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3952024-12-12T03:59:55.645ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3962024-12-12T03:59:55.645ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3972024-12-12T03:59:55.646ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-12-12T03:59:55.646ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3992024-12-12T03:59:55.649ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
4002024-12-12T03:59:55.683ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4012024-12-12T03:59:55.691ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/zone file = sled-storage/src/dataset.rs:303
4022024-12-12T03:59:55.872ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2 file = sled-storage/src/dataset.rs:389
4032024-12-12T03:59:55.882ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4042024-12-12T03:59:55.882ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4052024-12-12T03:59:55.882ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4062024-12-12T03:59:55.882ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4072024-12-12T03:59:55.882ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4082024-12-12T03:59:55.894ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4092024-12-12T03:59:55.894ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool)
4102024-12-12T03:59:55.985ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }
4112024-12-12T03:59:55.993ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4122024-12-12T03:59:55.993ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4132024-12-12T03:59:55.993ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4142024-12-12T03:59:55.993ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4152024-12-12T03:59:55.993ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4162024-12-12T03:59:55.993ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-12-12T03:59:55.993ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4182024-12-12T03:59:55.997ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 19.796280223s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80af691a-30bb-4399-8524-a68071b516df
4192024-12-12T03:59:56.037ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4202024-12-12T03:59:56.045ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f/crypt/zone file = sled-storage/src/dataset.rs:303
4212024-12-12T03:59:56.226ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f file = sled-storage/src/dataset.rs:389
4222024-12-12T03:59:56.235ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-12-12T03:59:56.235ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-12-12T03:59:56.235ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-12-12T03:59:56.235ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-12-12T03:59:56.235ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-12-12T03:59:56.245ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-12-12T03:59:56.245ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2ce90261-9b65-4601-b849-599cec034d39 (zpool)
4292024-12-12T03:59:56.341ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }
4302024-12-12T03:59:56.349ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4312024-12-12T03:59:56.349ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4322024-12-12T03:59:56.349ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4332024-12-12T03:59:56.349ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4342024-12-12T03:59:56.349ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-12-12T03:59:56.349ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-12-12T03:59:56.349ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4372024-12-12T03:59:56.386ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4382024-12-12T03:59:56.394ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2ce90261-9b65-4601-b849-599cec034d39/crypt/zone file = sled-storage/src/dataset.rs:303
4392024-12-12T03:59:56.568ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2ce90261-9b65-4601-b849-599cec034d39 file = sled-storage/src/dataset.rs:389
4402024-12-12T03:59:56.576ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4412024-12-12T03:59:56.576ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4422024-12-12T03:59:56.576ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-12-12T03:59:56.576ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1febdee-2c98-4f12-9aa4-ad18d04436bd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2db2571c-c8fc-49d7-9a67-c3d98ed7f856 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4442024-12-12T03:59:56.577ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4452024-12-12T03:59:56.577ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4462024-12-12T03:59:56.577ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-12-12T03:59:56.577ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = 80af691a-30bb-4399-8524-a68071b516df
4482024-12-12T03:59:56.577ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4492024-12-12T03:59:56.577ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = 80af691a-30bb-4399-8524-a68071b516df
4502024-12-12T03:59:56.577ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = 80af691a-30bb-4399-8524-a68071b516df
4512024-12-12T03:59:56.577ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = 80af691a-30bb-4399-8524-a68071b516df
4522024-12-12T03:59:56.577ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 80af691a-30bb-4399-8524-a68071b516df
4532024-12-12T03:59:56.577ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = 80af691a-30bb-4399-8524-a68071b516df
4542024-12-12T03:59:56.577ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4552024-12-12T03:59:56.577ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = 80af691a-30bb-4399-8524-a68071b516df
4562024-12-12T03:59:56.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3468296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58734 req_id = eedfb42e-4b42-465d-a8b8-52789536d1e6 response_code = 200 uri = /omicron-physical-disks
4572024-12-12T03:59:56.609ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {01afa7ba-86e1-4100-8336-523cec2c4e00 (dataset): DatasetConfig { id: 01afa7ba-86e1-4100-8336-523cec2c4e00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 037c8980-2413-42ed-a432-27bd870d8c27 (dataset): DatasetConfig { id: 037c8980-2413-42ed-a432-27bd870d8c27 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09b11e1d-595f-45bc-be26-fe68f9fc42a8 (dataset): DatasetConfig { id: 09b11e1d-595f-45bc-be26-fe68f9fc42a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c91f4f1-f0ee-4269-8dbf-5e599d9aa340 (dataset): DatasetConfig { id: 0c91f4f1-f0ee-4269-8dbf-5e599d9aa340 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c98ba84-60af-4ad1-9874-31fe20aae090 (dataset): DatasetConfig { id: 0c98ba84-60af-4ad1-9874-31fe20aae090 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f83b804-13b8-4085-9174-e9859ac580f7 (dataset): DatasetConfig { id: 0f83b804-13b8-4085-9174-e9859ac580f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11424529-da78-40d6-87a3-0215037219b9 (dataset): DatasetConfig { id: 11424529-da78-40d6-87a3-0215037219b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14d8f356-8086-4064-91a2-cf9f38743ef4 (dataset): DatasetConfig { id: 14d8f356-8086-4064-91a2-cf9f38743ef4 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c9152bf-4bd9-491c-82e4-50b252c24f90 (dataset): DatasetConfig { id: 1c9152bf-4bd9-491c-82e4-50b252c24f90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1cafc87b-6e88-4ebc-a539-45eb6b2a15f1 (dataset): DatasetConfig { id: 1cafc87b-6e88-4ebc-a539-45eb6b2a15f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 21636daf-d831-493a-b267-a493e808cda1 (dataset): DatasetConfig { id: 21636daf-d831-493a-b267-a493e808cda1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 286d1ac6-e1d1-4cac-9fbf-ae66aa996d3a (dataset): DatasetConfig { id: 286d1ac6-e1d1-4cac-9fbf-ae66aa996d3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 28d21b00-3f71-454e-a2c4-bc0040dce083 (dataset): DatasetConfig { id: 28d21b00-3f71-454e-a2c4-bc0040dce083 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c038993-2bbc-44a0-ae40-1c67eea0af8a (dataset): DatasetConfig { id: 2c038993-2bbc-44a0-ae40-1c67eea0af8a (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d75dcac-9bb7-4a72-86be-8acc2233e385 (dataset): DatasetConfig { id: 2d75dcac-9bb7-4a72-86be-8acc2233e385 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 339fb320-98d6-43d8-b4ab-b5bbbfbf066f (dataset): DatasetConfig { id: 339fb320-98d6-43d8-b4ab-b5bbbfbf066f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37bbeb49-e481-430d-ac3e-db9879c24be4 (dataset): DatasetConfig { id: 37bbeb49-e481-430d-ac3e-db9879c24be4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42aaf673-505a-413b-a7aa-e9afef41c72c (dataset): DatasetConfig { id: 42aaf673-505a-413b-a7aa-e9afef41c72c (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 431641c2-5a21-4a04-b5ac-aba8264a12d9 (dataset): DatasetConfig { id: 431641c2-5a21-4a04-b5ac-aba8264a12d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45207f78-5047-4359-a786-68002b55167a (dataset): DatasetConfig { id: 45207f78-5047-4359-a786-68002b55167a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 45a7566e-5392-4e4a-a79a-03a2ce5cb8d9 (dataset): DatasetConfig { id: 45a7566e-5392-4e4a-a79a-03a2ce5cb8d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4dd8b85f-5ddb-44f7-bff9-85b16ffde0b1 (dataset): DatasetConfig { id: 4dd8b85f-5ddb-44f7-bff9-85b16ffde0b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50c99304-83dc-4973-9e9a-8ff9fceef4d7 (dataset): DatasetConfig { id: 50c99304-83dc-4973-9e9a-8ff9fceef4d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5395ec3b-2f3c-4ed3-ad3e-a9558391aeb6 (dataset): DatasetConfig { id: 5395ec3b-2f3c-4ed3-ad3e-a9558391aeb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a441d4b-7dc1-4e7f-87ab-a6d3d398fa9f (dataset): DatasetConfig { id: 5a441d4b-7dc1-4e7f-87ab-a6d3d398fa9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 647c012f-9503-4510-b34b-1570267e4693 (dataset): DatasetConfig { id: 647c012f-9503-4510-b34b-1570267e4693 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 653587e5-a296-407e-b3a3-47552ad93850 (dataset): DatasetConfig { id: 653587e5-a296-407e-b3a3-47552ad93850 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 660ddf48-519e-4b18-8494-eb244c6c2a26 (dataset): DatasetConfig { id: 660ddf48-519e-4b18-8494-eb244c6c2a26 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 669506e7-41da-4368-88f3-3ad3a6445868 (dataset): DatasetConfig { id: 669506e7-41da-4368-88f3-3ad3a6445868 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6741d912-df2f-4e84-b48c-7e17ff35fc58 (dataset): DatasetConfig { id: 6741d912-df2f-4e84-b48c-7e17ff35fc58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6899bc4f-28b8-463c-aa1c-b877e429be30 (dataset): DatasetConfig { id: 6899bc4f-28b8-463c-aa1c-b877e429be30 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dc4c1fa-0f0d-4d5f-8584-ac729c5c6726 (dataset): DatasetConfig { id: 6dc4c1fa-0f0d-4d5f-8584-ac729c5c6726 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f5ed174-4093-4edf-956d-8184b8f1a943 (dataset): DatasetConfig { id: 7f5ed174-4093-4edf-956d-8184b8f1a943 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 807c9906-7404-4bdd-b9d4-972e28d6ac61 (dataset): DatasetConfig { id: 807c9906-7404-4bdd-b9d4-972e28d6ac61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85e09f4f-2433-47dc-aca9-f79942663b53 (dataset): DatasetConfig { id: 85e09f4f-2433-47dc-aca9-f79942663b53 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b2f950-11e7-4225-87a9-6d24ed400ad6 (dataset): DatasetConfig { id: 86b2f950-11e7-4225-87a9-6d24ed400ad6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 887a4427-7254-4425-a9e2-59742b9270e6 (dataset): DatasetConfig { id: 887a4427-7254-4425-a9e2-59742b9270e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89e7519c-19cb-4e6c-934a-9a35953151da (dataset): DatasetConfig { id: 89e7519c-19cb-4e6c-934a-9a35953151da (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b840d23-4b97-4f64-9e13-58cf44c5bed2 (dataset): DatasetConfig { id: 8b840d23-4b97-4f64-9e13-58cf44c5bed2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9db8dd73-3f6b-40db-be65-d157eba701f2 (dataset): DatasetConfig { id: 9db8dd73-3f6b-40db-be65-d157eba701f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a151ff30-93c0-4e26-8826-6c7462eb436d (dataset): DatasetConfig { id: a151ff30-93c0-4e26-8826-6c7462eb436d (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a854f763-0740-4eee-b148-ac06ce29a01a (dataset): DatasetConfig { id: a854f763-0740-4eee-b148-ac06ce29a01a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ab90541c-d42d-4be9-8303-5d705e8b1000 (dataset): DatasetConfig { id: ab90541c-d42d-4be9-8303-5d705e8b1000 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, adb164ab-97cd-4bf2-9b9d-869c3818cb1d (dataset): DatasetConfig { id: adb164ab-97cd-4bf2-9b9d-869c3818cb1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae4985ad-2b1b-45d5-9a07-d8d93cb11790 (dataset): DatasetConfig { id: ae4985ad-2b1b-45d5-9a07-d8d93cb11790 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af5ec90f-6d4f-4c55-9533-836be16877cc (dataset): DatasetConfig { id: af5ec90f-6d4f-4c55-9533-836be16877cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0ff8e51-efe5-4ec8-ad8e-69f709f450a8 (dataset): DatasetConfig { id: c0ff8e51-efe5-4ec8-ad8e-69f709f450a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4b5f8e2-bebf-4935-88f6-369ec394fe1b (dataset): DatasetConfig { id: c4b5f8e2-bebf-4935-88f6-369ec394fe1b (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c62cea9c-a82e-4555-abe7-8c786fdcf167 (dataset): DatasetConfig { id: c62cea9c-a82e-4555-abe7-8c786fdcf167 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c70f3877-7e72-4e44-8f73-51a7d3e94569 (dataset): DatasetConfig { id: c70f3877-7e72-4e44-8f73-51a7d3e94569 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c78c3edf-4d18-49f3-9e29-8efc59d7a0c7 (dataset): DatasetConfig { id: c78c3edf-4d18-49f3-9e29-8efc59d7a0c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d212dd50-6c7a-4164-802f-4c8e7591b344 (dataset): DatasetConfig { id: d212dd50-6c7a-4164-802f-4c8e7591b344 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dd9d2c6f-19e5-44b6-a452-f1860715edc4 (dataset): DatasetConfig { id: dd9d2c6f-19e5-44b6-a452-f1860715edc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df64a72f-946b-4cbb-a602-654f94043c3e (dataset): DatasetConfig { id: df64a72f-946b-4cbb-a602-654f94043c3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2b3195a-582d-4115-8e73-dda5b4775b79 (dataset): DatasetConfig { id: e2b3195a-582d-4115-8e73-dda5b4775b79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8a42fa6-aff2-4f41-948a-7e3a98454e9f (dataset): DatasetConfig { id: e8a42fa6-aff2-4f41-948a-7e3a98454e9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea01257b-d24e-4f12-965f-9d6407c7276d (dataset): DatasetConfig { id: ea01257b-d24e-4f12-965f-9d6407c7276d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ea49b58c-b41e-4837-85e4-1627952f7992 (dataset): DatasetConfig { id: ea49b58c-b41e-4837-85e4-1627952f7992 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f058ff1d-3234-43a2-9a07-e39721cb6b44 (dataset): DatasetConfig { id: f058ff1d-3234-43a2-9a07-e39721cb6b44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f09be1f7-b1f4-46f4-bc8a-f353f6ad7159 (dataset): DatasetConfig { id: f09be1f7-b1f4-46f4-bc8a-f353f6ad7159 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1a8e13f-975a-46a0-997a-23213022fb5e (dataset): DatasetConfig { id: f1a8e13f-975a-46a0-997a-23213022fb5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2fceca5-8230-4c9f-8371-41360eee296c (dataset): DatasetConfig { id: f2fceca5-8230-4c9f-8371-41360eee296c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f4ace980-a06e-4e9c-bfcc-f6c83c69ba1e (dataset): DatasetConfig { id: f4ace980-a06e-4e9c-bfcc-f6c83c69ba1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9d78cdb-a562-4131-9093-3fd74bc28a23 (dataset): DatasetConfig { id: f9d78cdb-a562-4131-9093-3fd74bc28a23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb128452-a6e1-4c80-bc52-d8e1b877c1fb (dataset): DatasetConfig { id: fb128452-a6e1-4c80-bc52-d8e1b877c1fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd1867cb-d137-4c88-818c-253d8b9cad43 (dataset): DatasetConfig { id: fd1867cb-d137-4c88-818c-253d8b9cad43 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:444 sled_address = [fd00:1122:3344:101::1]:12345
4582024-12-12T03:59:56.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37669
4592024-12-12T03:59:56.609ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = 80af691a-30bb-4399-8524-a68071b516df
4602024-12-12T03:59:56.612ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {01afa7ba-86e1-4100-8336-523cec2c4e00 (dataset): DatasetConfig { id: 01afa7ba-86e1-4100-8336-523cec2c4e00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 037c8980-2413-42ed-a432-27bd870d8c27 (dataset): DatasetConfig { id: 037c8980-2413-42ed-a432-27bd870d8c27 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09b11e1d-595f-45bc-be26-fe68f9fc42a8 (dataset): DatasetConfig { id: 09b11e1d-595f-45bc-be26-fe68f9fc42a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c91f4f1-f0ee-4269-8dbf-5e599d9aa340 (dataset): DatasetConfig { id: 0c91f4f1-f0ee-4269-8dbf-5e599d9aa340 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c98ba84-60af-4ad1-9874-31fe20aae090 (dataset): DatasetConfig { id: 0c98ba84-60af-4ad1-9874-31fe20aae090 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f83b804-13b8-4085-9174-e9859ac580f7 (dataset): DatasetConfig { id: 0f83b804-13b8-4085-9174-e9859ac580f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11424529-da78-40d6-87a3-0215037219b9 (dataset): DatasetConfig { id: 11424529-da78-40d6-87a3-0215037219b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14d8f356-8086-4064-91a2-cf9f38743ef4 (dataset): DatasetConfig { id: 14d8f356-8086-4064-91a2-cf9f38743ef4 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c9152bf-4bd9-491c-82e4-50b252c24f90 (dataset): DatasetConfig { id: 1c9152bf-4bd9-491c-82e4-50b252c24f90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1cafc87b-6e88-4ebc-a539-45eb6b2a15f1 (dataset): DatasetConfig { id: 1cafc87b-6e88-4ebc-a539-45eb6b2a15f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 21636daf-d831-493a-b267-a493e808cda1 (dataset): DatasetConfig { id: 21636daf-d831-493a-b267-a493e808cda1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 286d1ac6-e1d1-4cac-9fbf-ae66aa996d3a (dataset): DatasetConfig { id: 286d1ac6-e1d1-4cac-9fbf-ae66aa996d3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 28d21b00-3f71-454e-a2c4-bc0040dce083 (dataset): DatasetConfig { id: 28d21b00-3f71-454e-a2c4-bc0040dce083 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c038993-2bbc-44a0-ae40-1c67eea0af8a (dataset): DatasetConfig { id: 2c038993-2bbc-44a0-ae40-1c67eea0af8a (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d75dcac-9bb7-4a72-86be-8acc2233e385 (dataset): DatasetConfig { id: 2d75dcac-9bb7-4a72-86be-8acc2233e385 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 339fb320-98d6-43d8-b4ab-b5bbbfbf066f (dataset): DatasetConfig { id: 339fb320-98d6-43d8-b4ab-b5bbbfbf066f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37bbeb49-e481-430d-ac3e-db9879c24be4 (dataset): DatasetConfig { id: 37bbeb49-e481-430d-ac3e-db9879c24be4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42aaf673-505a-413b-a7aa-e9afef41c72c (dataset): DatasetConfig { id: 42aaf673-505a-413b-a7aa-e9afef41c72c (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 431641c2-5a21-4a04-b5ac-aba8264a12d9 (dataset): DatasetConfig { id: 431641c2-5a21-4a04-b5ac-aba8264a12d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45207f78-5047-4359-a786-68002b55167a (dataset): DatasetConfig { id: 45207f78-5047-4359-a786-68002b55167a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 45a7566e-5392-4e4a-a79a-03a2ce5cb8d9 (dataset): DatasetConfig { id: 45a7566e-5392-4e4a-a79a-03a2ce5cb8d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4dd8b85f-5ddb-44f7-bff9-85b16ffde0b1 (dataset): DatasetConfig { id: 4dd8b85f-5ddb-44f7-bff9-85b16ffde0b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50c99304-83dc-4973-9e9a-8ff9fceef4d7 (dataset): DatasetConfig { id: 50c99304-83dc-4973-9e9a-8ff9fceef4d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5395ec3b-2f3c-4ed3-ad3e-a9558391aeb6 (dataset): DatasetConfig { id: 5395ec3b-2f3c-4ed3-ad3e-a9558391aeb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a441d4b-7dc1-4e7f-87ab-a6d3d398fa9f (dataset): DatasetConfig { id: 5a441d4b-7dc1-4e7f-87ab-a6d3d398fa9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 647c012f-9503-4510-b34b-1570267e4693 (dataset): DatasetConfig { id: 647c012f-9503-4510-b34b-1570267e4693 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 653587e5-a296-407e-b3a3-47552ad93850 (dataset): DatasetConfig { id: 653587e5-a296-407e-b3a3-47552ad93850 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 660ddf48-519e-4b18-8494-eb244c6c2a26 (dataset): DatasetConfig { id: 660ddf48-519e-4b18-8494-eb244c6c2a26 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 669506e7-41da-4368-88f3-3ad3a6445868 (dataset): DatasetConfig { id: 669506e7-41da-4368-88f3-3ad3a6445868 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6741d912-df2f-4e84-b48c-7e17ff35fc58 (dataset): DatasetConfig { id: 6741d912-df2f-4e84-b48c-7e17ff35fc58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6899bc4f-28b8-463c-aa1c-b877e429be30 (dataset): DatasetConfig { id: 6899bc4f-28b8-463c-aa1c-b877e429be30 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dc4c1fa-0f0d-4d5f-8584-ac729c5c6726 (dataset): DatasetConfig { id: 6dc4c1fa-0f0d-4d5f-8584-ac729c5c6726 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f5ed174-4093-4edf-956d-8184b8f1a943 (dataset): DatasetConfig { id: 7f5ed174-4093-4edf-956d-8184b8f1a943 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 807c9906-7404-4bdd-b9d4-972e28d6ac61 (dataset): DatasetConfig { id: 807c9906-7404-4bdd-b9d4-972e28d6ac61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85e09f4f-2433-47dc-aca9-f79942663b53 (dataset): DatasetConfig { id: 85e09f4f-2433-47dc-aca9-f79942663b53 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b2f950-11e7-4225-87a9-6d24ed400ad6 (dataset): DatasetConfig { id: 86b2f950-11e7-4225-87a9-6d24ed400ad6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 887a4427-7254-4425-a9e2-59742b9270e6 (dataset): DatasetConfig { id: 887a4427-7254-4425-a9e2-59742b9270e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89e7519c-19cb-4e6c-934a-9a35953151da (dataset): DatasetConfig { id: 89e7519c-19cb-4e6c-934a-9a35953151da (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b840d23-4b97-4f64-9e13-58cf44c5bed2 (dataset): DatasetConfig { id: 8b840d23-4b97-4f64-9e13-58cf44c5bed2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9db8dd73-3f6b-40db-be65-d157eba701f2 (dataset): DatasetConfig { id: 9db8dd73-3f6b-40db-be65-d157eba701f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a151ff30-93c0-4e26-8826-6c7462eb436d (dataset): DatasetConfig { id: a151ff30-93c0-4e26-8826-6c7462eb436d (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a854f763-0740-4eee-b148-ac06ce29a01a (dataset): DatasetConfig { id: a854f763-0740-4eee-b148-ac06ce29a01a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ab90541c-d42d-4be9-8303-5d705e8b1000 (dataset): DatasetConfig { id: ab90541c-d42d-4be9-8303-5d705e8b1000 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, adb164ab-97cd-4bf2-9b9d-869c3818cb1d (dataset): DatasetConfig { id: adb164ab-97cd-4bf2-9b9d-869c3818cb1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae4985ad-2b1b-45d5-9a07-d8d93cb11790 (dataset): DatasetConfig { id: ae4985ad-2b1b-45d5-9a07-d8d93cb11790 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af5ec90f-6d4f-4c55-9533-836be16877cc (dataset): DatasetConfig { id: af5ec90f-6d4f-4c55-9533-836be16877cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0ff8e51-efe5-4ec8-ad8e-69f709f450a8 (dataset): DatasetConfig { id: c0ff8e51-efe5-4ec8-ad8e-69f709f450a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4b5f8e2-bebf-4935-88f6-369ec394fe1b (dataset): DatasetConfig { id: c4b5f8e2-bebf-4935-88f6-369ec394fe1b (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c62cea9c-a82e-4555-abe7-8c786fdcf167 (dataset): DatasetConfig { id: c62cea9c-a82e-4555-abe7-8c786fdcf167 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c70f3877-7e72-4e44-8f73-51a7d3e94569 (dataset): DatasetConfig { id: c70f3877-7e72-4e44-8f73-51a7d3e94569 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c78c3edf-4d18-49f3-9e29-8efc59d7a0c7 (dataset): DatasetConfig { id: c78c3edf-4d18-49f3-9e29-8efc59d7a0c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d212dd50-6c7a-4164-802f-4c8e7591b344 (dataset): DatasetConfig { id: d212dd50-6c7a-4164-802f-4c8e7591b344 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dd9d2c6f-19e5-44b6-a452-f1860715edc4 (dataset): DatasetConfig { id: dd9d2c6f-19e5-44b6-a452-f1860715edc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df64a72f-946b-4cbb-a602-654f94043c3e (dataset): DatasetConfig { id: df64a72f-946b-4cbb-a602-654f94043c3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2b3195a-582d-4115-8e73-dda5b4775b79 (dataset): DatasetConfig { id: e2b3195a-582d-4115-8e73-dda5b4775b79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8a42fa6-aff2-4f41-948a-7e3a98454e9f (dataset): DatasetConfig { id: e8a42fa6-aff2-4f41-948a-7e3a98454e9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea01257b-d24e-4f12-965f-9d6407c7276d (dataset): DatasetConfig { id: ea01257b-d24e-4f12-965f-9d6407c7276d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ea49b58c-b41e-4837-85e4-1627952f7992 (dataset): DatasetConfig { id: ea49b58c-b41e-4837-85e4-1627952f7992 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f058ff1d-3234-43a2-9a07-e39721cb6b44 (dataset): DatasetConfig { id: f058ff1d-3234-43a2-9a07-e39721cb6b44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f09be1f7-b1f4-46f4-bc8a-f353f6ad7159 (dataset): DatasetConfig { id: f09be1f7-b1f4-46f4-bc8a-f353f6ad7159 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1a8e13f-975a-46a0-997a-23213022fb5e (dataset): DatasetConfig { id: f1a8e13f-975a-46a0-997a-23213022fb5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2fceca5-8230-4c9f-8371-41360eee296c (dataset): DatasetConfig { id: f2fceca5-8230-4c9f-8371-41360eee296c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f4ace980-a06e-4e9c-bfcc-f6c83c69ba1e (dataset): DatasetConfig { id: f4ace980-a06e-4e9c-bfcc-f6c83c69ba1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9d78cdb-a562-4131-9093-3fd74bc28a23 (dataset): DatasetConfig { id: f9d78cdb-a562-4131-9093-3fd74bc28a23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb128452-a6e1-4c80-bc52-d8e1b877c1fb (dataset): DatasetConfig { id: fb128452-a6e1-4c80-bc52-d8e1b877c1fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd1867cb-d137-4c88-818c-253d8b9cad43 (dataset): DatasetConfig { id: fd1867cb-d137-4c88-818c-253d8b9cad43 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4612024-12-12T03:59:56.612ZINFOSledAgent (StorageManager): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4622024-12-12T03:59:56.612ZINFOSledAgent (StorageManager): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4632024-12-12T03:59:56.612ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4642024-12-12T03:59:56.612ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-12-12T03:59:56.612ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/zone/oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), full_name: "oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/zone/oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af" } file = sled-storage/src/manager.rs:1331
4662024-12-12T03:59:56.651ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
4672024-12-12T03:59:56.708ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-12-12T03:59:56.708ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ce90261-9b65-4601-b849-599cec034d39/crypt/zone"), full_name: "oxp_2ce90261-9b65-4601-b849-599cec034d39/crypt/zone" } file = sled-storage/src/manager.rs:1331
4692024-12-12T03:59:56.776ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-12-12T03:59:56.777ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/zone/oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc"), full_name: "oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/zone/oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc" } file = sled-storage/src/manager.rs:1331
4712024-12-12T03:59:56.875ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-12-12T03:59:56.875ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/zone/oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab"), full_name: "oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/zone/oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab" } file = sled-storage/src/manager.rs:1331
4732024-12-12T03:59:56.972ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-12-12T03:59:56.972ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/zone/oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7"), full_name: "oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/zone/oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7" } file = sled-storage/src/manager.rs:1331
4752024-12-12T03:59:57.071ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-12-12T03:59:57.071ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/zone/oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b"), full_name: "oxp_4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/zone/oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b" } file = sled-storage/src/manager.rs:1331
4772024-12-12T03:59:57.169ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-12-12T03:59:57.169ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crucible" } file = sled-storage/src/manager.rs:1331
4792024-12-12T03:59:57.255ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-12-12T03:59:57.255ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/zone/oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4"), full_name: "oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/zone/oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4" } file = sled-storage/src/manager.rs:1331
4812024-12-12T03:59:57.351ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-12-12T03:59:57.351ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2/crucible" } file = sled-storage/src/manager.rs:1331
4832024-12-12T03:59:57.439ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-12-12T03:59:57.439ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f09e596-8c3b-4084-9722-b9e187b46c0f/crypt/zone"), full_name: "oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f/crypt/zone" } file = sled-storage/src/manager.rs:1331
4852024-12-12T03:59:57.507ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-12-12T03:59:57.507ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f09e596-8c3b-4084-9722-b9e187b46c0f/crypt/debug"), full_name: "oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f/crypt/debug" } file = sled-storage/src/manager.rs:1331
4872024-12-12T03:59:57.574ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-12-12T03:59:57.574ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/zone/oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9"), full_name: "oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/zone/oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9" } file = sled-storage/src/manager.rs:1331
4892024-12-12T03:59:57.654ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
4902024-12-12T03:59:57.673ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-12-12T03:59:57.673ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/zone/oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da"), full_name: "oxp_4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/zone/oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da" } file = sled-storage/src/manager.rs:1331
4922024-12-12T03:59:57.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-12-12T03:59:57.770ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crucible" } file = sled-storage/src/manager.rs:1331
4942024-12-12T03:59:57.857ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-12-12T03:59:57.857ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone/oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone/oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28" } file = sled-storage/src/manager.rs:1331
4962024-12-12T03:59:57.959ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-12-12T03:59:57.959ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/zone/oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a"), full_name: "oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/zone/oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a" } file = sled-storage/src/manager.rs:1331
4982024-12-12T03:59:58.062ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-12-12T03:59:58.062ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/zone"), full_name: "oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/zone" } file = sled-storage/src/manager.rs:1331
5002024-12-12T03:59:58.130ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-12-12T03:59:58.130ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone" } file = sled-storage/src/manager.rs:1331
5022024-12-12T03:59:58.197ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-12-12T03:59:58.197ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/zone/oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115"), full_name: "oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/zone/oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115" } file = sled-storage/src/manager.rs:1331
5042024-12-12T03:59:58.296ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-12-12T03:59:58.296ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/debug"), full_name: "oxp_4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/debug" } file = sled-storage/src/manager.rs:1331
5062024-12-12T03:59:58.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-12-12T03:59:58.364ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crucible" } file = sled-storage/src/manager.rs:1331
5082024-12-12T03:59:58.451ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-12-12T03:59:58.451ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5102024-12-12T03:59:58.539ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-12-12T03:59:58.539ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/zone/oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1"), full_name: "oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/zone/oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1" } file = sled-storage/src/manager.rs:1331
5122024-12-12T03:59:58.639ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-12-12T03:59:58.639ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/zone/oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25"), full_name: "oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/zone/oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25" } file = sled-storage/src/manager.rs:1331
5142024-12-12T03:59:58.657ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
5152024-12-12T03:59:58.735ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-12-12T03:59:58.735ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/zone"), full_name: "oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/zone" } file = sled-storage/src/manager.rs:1331
5172024-12-12T03:59:58.803ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-12-12T03:59:58.803ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5192024-12-12T03:59:58.892ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-12-12T03:59:58.892ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/zone/oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e"), full_name: "oxp_4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/zone/oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e" } file = sled-storage/src/manager.rs:1331
5212024-12-12T03:59:58.991ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-12-12T03:59:58.991ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone/oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone/oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b" } file = sled-storage/src/manager.rs:1331
5232024-12-12T03:59:59.093ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-12-12T03:59:59.093ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f/crucible" } file = sled-storage/src/manager.rs:1331
5252024-12-12T03:59:59.183ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-12-12T03:59:59.183ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/debug"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/debug" } file = sled-storage/src/manager.rs:1331
5272024-12-12T03:59:59.252ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-12-12T03:59:59.252ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2ce90261-9b65-4601-b849-599cec034d39/crucible" } file = sled-storage/src/manager.rs:1331
5292024-12-12T03:59:59.340ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-12-12T03:59:59.340ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5312024-12-12T03:59:59.429ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-12-12T03:59:59.429ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/debug"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/debug" } file = sled-storage/src/manager.rs:1331
5332024-12-12T03:59:59.498ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-12-12T03:59:59.498ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crucible" } file = sled-storage/src/manager.rs:1331
5352024-12-12T03:59:59.584ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-12-12T03:59:59.584ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5372024-12-12T03:59:59.658ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
5382024-12-12T03:59:59.674ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5392024-12-12T03:59:59.674ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/zone"), full_name: "oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/zone" } file = sled-storage/src/manager.rs:1331
5402024-12-12T03:59:59.742ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-12-12T03:59:59.742ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone/oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone/oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39" } file = sled-storage/src/manager.rs:1331
5422024-12-12T03:59:59.841ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-12-12T03:59:59.841ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/zone/oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189"), full_name: "oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/zone/oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189" } file = sled-storage/src/manager.rs:1331
5442024-12-12T03:59:59.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-12-12T03:59:59.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone/oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone/oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2" } file = sled-storage/src/manager.rs:1331
5462024-12-12T04:00:00.045ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-12-12T04:00:00.045ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f09e596-8c3b-4084-9722-b9e187b46c0f/crypt/zone/oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3"), full_name: "oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f/crypt/zone/oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3" } file = sled-storage/src/manager.rs:1331
5482024-12-12T04:00:00.141ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-12-12T04:00:00.141ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5502024-12-12T04:00:00.229ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-12-12T04:00:00.229ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/debug"), full_name: "oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/debug" } file = sled-storage/src/manager.rs:1331
5522024-12-12T04:00:00.298ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-12-12T04:00:00.298ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/debug"), full_name: "oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/debug" } file = sled-storage/src/manager.rs:1331
5542024-12-12T04:00:00.364ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-12-12T04:00:00.364ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ce90261-9b65-4601-b849-599cec034d39/crypt/zone/oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56"), full_name: "oxp_2ce90261-9b65-4601-b849-599cec034d39/crypt/zone/oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56" } file = sled-storage/src/manager.rs:1331
5562024-12-12T04:00:00.459ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-12-12T04:00:00.459ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5582024-12-12T04:00:00.551ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-12-12T04:00:00.551ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ce90261-9b65-4601-b849-599cec034d39/crypt/zone/oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e"), full_name: "oxp_2ce90261-9b65-4601-b849-599cec034d39/crypt/zone/oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e" } file = sled-storage/src/manager.rs:1331
5602024-12-12T04:00:00.653ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-12-12T04:00:00.653ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5622024-12-12T04:00:00.664ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
5632024-12-12T04:00:00.744ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-12-12T04:00:00.744ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone/oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone/oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373" } file = sled-storage/src/manager.rs:1331
5652024-12-12T04:00:00.843ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-12-12T04:00:00.843ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5672024-12-12T04:00:00.934ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-12-12T04:00:00.934ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/zone"), full_name: "oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/zone" } file = sled-storage/src/manager.rs:1331
5692024-12-12T04:00:01.001ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-12-12T04:00:01.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5712024-12-12T04:00:01.118ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-12-12T04:00:01.118ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/debug"), full_name: "oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/debug" } file = sled-storage/src/manager.rs:1331
5732024-12-12T04:00:01.187ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-12-12T04:00:01.187ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crucible" } file = sled-storage/src/manager.rs:1331
5752024-12-12T04:00:01.275ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5762024-12-12T04:00:01.275ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/zone/oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def"), full_name: "oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/zone/oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def" } file = sled-storage/src/manager.rs:1331
5772024-12-12T04:00:01.375ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-12-12T04:00:01.375ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone/oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone/oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719" } file = sled-storage/src/manager.rs:1331
5792024-12-12T04:00:01.475ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-12-12T04:00:01.475ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone/oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone/oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6" } file = sled-storage/src/manager.rs:1331
5812024-12-12T04:00:01.573ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5822024-12-12T04:00:01.573ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ce90261-9b65-4601-b849-599cec034d39/crypt/debug"), full_name: "oxp_2ce90261-9b65-4601-b849-599cec034d39/crypt/debug" } file = sled-storage/src/manager.rs:1331
5832024-12-12T04:00:01.642ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5842024-12-12T04:00:01.642ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone/oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone/oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee" } file = sled-storage/src/manager.rs:1331
5852024-12-12T04:00:01.667ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
5862024-12-12T04:00:01.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5872024-12-12T04:00:01.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4b8ca783-c0e0-4c3f-a149-be038075af29/crucible" } file = sled-storage/src/manager.rs:1331
5882024-12-12T04:00:01.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5892024-12-12T04:00:01.829ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5902024-12-12T04:00:01.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5912024-12-12T04:00:01.919ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone/oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone/oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf" } file = sled-storage/src/manager.rs:1331
5922024-12-12T04:00:02.032ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5932024-12-12T04:00:02.032ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/debug"), full_name: "oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/debug" } file = sled-storage/src/manager.rs:1331
5942024-12-12T04:00:02.109ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5952024-12-12T04:00:02.109ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/zone"), full_name: "oxp_4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/zone" } file = sled-storage/src/manager.rs:1331
5962024-12-12T04:00:02.184ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5972024-12-12T04:00:02.184ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5982024-12-12T04:00:02.280ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5992024-12-12T04:00:02.280ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone"), full_name: "oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/zone" } file = sled-storage/src/manager.rs:1331
6002024-12-12T04:00:02.355ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6012024-12-12T04:00:02.355ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone/oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f"), full_name: "oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/zone/oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f" } file = sled-storage/src/manager.rs:1331
6022024-12-12T04:00:02.423ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6032024-12-12T04:00:02.423ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6042024-12-12T04:00:02.430ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6052024-12-12T04:00:02.430ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
6062024-12-12T04:00:02.468ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6072024-12-12T04:00:02.468ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6082024-12-12T04:00:02.469ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = 80af691a-30bb-4399-8524-a68071b516df
6092024-12-12T04:00:02.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5859839 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37669 req_id = 800f2f69-d0ad-4060-bfc9-d39c17a7334a response_code = 200 uri = /datasets
6102024-12-12T04:00:02.515ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28 (service), filesystem_pool: Some(ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d24a9d9f-7884-44e6-bf52-febe49c3b719 (service), filesystem_pool: Some(ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 68b92f4b-c208-4567-8395-96046a9b6c9a (service), filesystem_pool: Some(ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
6112024-12-12T04:00:02.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61086
6122024-12-12T04:00:02.515ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6132024-12-12T04:00:02.515ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6142024-12-12T04:00:02.538ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 663650057557475238 sled_id = 80af691a-30bb-4399-8524-a68071b516df
6152024-12-12T04:00:02.538ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5155637728408535992 sled_id = 80af691a-30bb-4399-8524-a68071b516df
6162024-12-12T04:00:02.554ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d24a9d9f-7884-44e6-bf52-febe49c3b719, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6172024-12-12T04:00:02.554ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d24a9d9f-7884-44e6-bf52-febe49c3b719, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6182024-12-12T04:00:02.590ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 68b92f4b-c208-4567-8395-96046a9b6c9a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6192024-12-12T04:00:02.590ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 68b92f4b-c208-4567-8395-96046a9b6c9a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: InternalDns }, responder: ... }
6202024-12-12T04:00:02.591ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
6212024-12-12T04:00:02.591ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
6222024-12-12T04:00:02.624ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6232024-12-12T04:00:02.624ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-zones.json file = common/src/ledger.rs:188
6242024-12-12T04:00:02.624ZINFOSledAgent (ServiceManager): No ledger in /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-zones.json file = common/src/ledger.rs:188
6252024-12-12T04:00:02.624ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6262024-12-12T04:00:02.638ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
6272024-12-12T04:00:02.638ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
6282024-12-12T04:00:02.670ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
6292024-12-12T04:00:02.678ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6302024-12-12T04:00:02.678ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6312024-12-12T04:00:02.678ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6322024-12-12T04:00:02.694ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
6332024-12-12T04:00:02.694ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
6342024-12-12T04:00:02.717ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
6352024-12-12T04:00:02.717ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
6362024-12-12T04:00:02.743ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719 file = illumos-utils/src/zone.rs:325
6372024-12-12T04:00:02.747ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a file = illumos-utils/src/zone.rs:325
6382024-12-12T04:00:02.751ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28 file = illumos-utils/src/zone.rs:325
6392024-12-12T04:00:02.764ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719 file = illumos-utils/src/zone.rs:363
6402024-12-12T04:00:02.771ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a file = illumos-utils/src/zone.rs:363
6412024-12-12T04:00:02.775ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28 file = illumos-utils/src/zone.rs:363
6422024-12-12T04:00:02.802ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
6432024-12-12T04:00:02.802ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
6442024-12-12T04:00:02.937ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
6452024-12-12T04:00:02.937ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6462024-12-12T04:00:02.981ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6472024-12-12T04:00:02.982ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/nexus.rs:527 sled_id = 80af691a-30bb-4399-8524-a68071b516df
6482024-12-12T04:00:03.017ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6492024-12-12T04:00:03.017ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6502024-12-12T04:00:03.017ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6512024-12-12T04:00:03.017ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6522024-12-12T04:00:03.064ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
6532024-12-12T04:00:03.135ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6542024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6552024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6562024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6572024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6582024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6592024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6602024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6612024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6622024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6632024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6642024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6652024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6662024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6672024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6682024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6692024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6702024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6712024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6722024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6732024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6742024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6752024-12-12T04:00:03.135ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6762024-12-12T04:00:03.473ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
6772024-12-12T04:00:03.473ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
6782024-12-12T04:00:03.671ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80af691a-30bb-4399-8524-a68071b516df) file = sled-agent/src/probe_manager.rs:231 sled_id = 80af691a-30bb-4399-8524-a68071b516df
6792024-12-12T04:00:04.408ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-12-12T04:00:04.408ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6812024-12-12T04:00:04.887ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822024-12-12T04:00:05.365ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6832024-12-12T04:00:05.365ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842024-12-12T04:00:05.365ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
6852024-12-12T04:00:05.369ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6862024-12-12T04:00:05.369ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719
6872024-12-12T04:00:05.374ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a
6882024-12-12T04:00:05.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28") failed: Property not found. retry in 27.866398ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
6892024-12-12T04:00:05.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719") failed: Property not found. retry in 27.785202ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719
6902024-12-12T04:00:05.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a") failed: Property not found. retry in 73.22694ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a
6912024-12-12T04:00:05.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28") failed: Property not found. retry in 53.220632ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
6922024-12-12T04:00:05.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719") failed: Property not found. retry in 107.263889ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719
6932024-12-12T04:00:05.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a") failed: Property not found. retry in 93.562715ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a
6942024-12-12T04:00:05.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28") failed: Property not found. retry in 247.604031ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
6952024-12-12T04:00:05.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719") failed: Property not found. retry in 130.494884ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719
6962024-12-12T04:00:06.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a") failed: Property not found. retry in 197.352406ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a
6972024-12-12T04:00:06.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719") failed: Property not found. retry in 502.844942ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719
6982024-12-12T04:00:06.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28") failed: Property not found. retry in 317.087863ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
6992024-12-12T04:00:06.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a") failed: Property not found. retry in 431.673536ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a
7002024-12-12T04:00:06.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28") failed: Property not found. retry in 694.558932ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
7012024-12-12T04:00:06.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719") failed: Property not found. retry in 1.161879496s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719
7022024-12-12T04:00:06.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a") failed: Property not found. retry in 1.0732469s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a
7032024-12-12T04:00:07.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28") failed: Property not found. retry in 1.228650553s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
7042024-12-12T04:00:07.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a") failed: Property not found. retry in 990.532703ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a
7052024-12-12T04:00:07.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719") failed: Property not found. retry in 1.180897407s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719
7062024-12-12T04:00:08.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28") failed: Property not found. retry in 906.21631ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
7072024-12-12T04:00:08.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a") failed: Property not found. retry in 1.369860575s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a
7082024-12-12T04:00:09.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719") failed: Property not found. retry in 784.165238ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719
7092024-12-12T04:00:09.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28") failed: Property not found. retry in 1.088170848s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
7102024-12-12T04:00:09.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719") failed: Property not found. retry in 1.065966396s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719
7112024-12-12T04:00:10.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a") failed: Property not found. retry in 1.241710791s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a
7122024-12-12T04:00:10.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28") failed: Property not found. retry in 554.065018ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
7132024-12-12T04:00:11.423ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_d24a9d9f-7884-44e6-bf52-febe49c3b719
7142024-12-12T04:00:11.423ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_68b92f4b-c208-4567-8395-96046a9b6c9a
7152024-12-12T04:00:11.423ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_c9c9afd6-aa03-4a96-8241-6ae7ccfbce28
7162024-12-12T04:00:11.423ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7172024-12-12T04:00:11.424ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7182024-12-12T04:00:11.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8908711 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61086 req_id = f2f786aa-fe8f-4b55-8e1e-9e48bf6f58fb response_code = 204 uri = /omicron-zones
7192024-12-12T04:00:11.426ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7202024-12-12T04:00:11.881ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 133.231228ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:662
7212024-12-12T04:00:12.033ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7222024-12-12T04:00:12.079ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7232024-12-12T04:00:12.126ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:678
7242024-12-12T04:00:12.126ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7252024-12-12T04:00:12.157ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7262024-12-12T04:00:12.158ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7272024-12-12T04:00:12.158ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7282024-12-12T04:00:12.188ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28 (service), filesystem_pool: Some(ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d24a9d9f-7884-44e6-bf52-febe49c3b719 (service), filesystem_pool: Some(ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 68b92f4b-c208-4567-8395-96046a9b6c9a (service), filesystem_pool: Some(ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e93c7fbd-e5ba-471c-9eb8-f8ab296db8da (service), filesystem_pool: Some(ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 270d86f3-7e6c-4b65-b865-bb90b66ba1dd, kind: Service { id: e93c7fbd-e5ba-471c-9eb8-f8ab296db8da }, name: Name("ntp-e93c7fbd-e5ba-471c-9eb8-f8ab296db8da"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 148])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
7292024-12-12T04:00:12.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44785
7302024-12-12T04:00:12.188ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7312024-12-12T04:00:12.188ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7322024-12-12T04:00:12.228ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d24a9d9f-7884-44e6-bf52-febe49c3b719, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7332024-12-12T04:00:12.229ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d24a9d9f-7884-44e6-bf52-febe49c3b719, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7342024-12-12T04:00:12.265ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 68b92f4b-c208-4567-8395-96046a9b6c9a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7352024-12-12T04:00:12.265ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 68b92f4b-c208-4567-8395-96046a9b6c9a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: InternalDns }, responder: ... }
7362024-12-12T04:00:12.300ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7372024-12-12T04:00:12.300ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-zones.json file = common/src/ledger.rs:177
7382024-12-12T04:00:12.300ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-zones.json file = common/src/ledger.rs:177
7392024-12-12T04:00:12.300ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7402024-12-12T04:00:12.311ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7412024-12-12T04:00:12.343ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7422024-12-12T04:00:12.344ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7432024-12-12T04:00:12.344ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7442024-12-12T04:00:12.374ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 219, 148]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7452024-12-12T04:00:12.374ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7462024-12-12T04:00:12.375ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7472024-12-12T04:00:12.375ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7482024-12-12T04:00:12.375ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7492024-12-12T04:00:12.375ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7502024-12-12T04:00:12.400ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da file = illumos-utils/src/zone.rs:325
7512024-12-12T04:00:12.417ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da file = illumos-utils/src/zone.rs:363
7522024-12-12T04:00:12.540ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 663650057557475238 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7532024-12-12T04:00:12.540ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5155637728408535992 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7542024-12-12T04:00:13.036ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7552024-12-12T04:00:13.036ZINFOSledAgent (ServiceManager): Booting oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7562024-12-12T04:00:13.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da") failed: Property not found. retry in 36.09081ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7572024-12-12T04:00:13.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da") failed: Property not found. retry in 147.738722ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7582024-12-12T04:00:13.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da") failed: Property not found. retry in 246.484191ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7592024-12-12T04:00:13.476ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7602024-12-12T04:00:13.476ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7612024-12-12T04:00:13.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da") failed: Property not found. retry in 487.879894ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7622024-12-12T04:00:14.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da") failed: Property not found. retry in 500.280819ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7632024-12-12T04:00:14.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da") failed: Property not found. retry in 886.111486ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7642024-12-12T04:00:15.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da") failed: Property not found. retry in 546.549307ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7652024-12-12T04:00:16.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da") failed: Property not found. retry in 728.393629ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7662024-12-12T04:00:16.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da") failed: Property not found. retry in 850.039335ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7672024-12-12T04:00:17.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da") failed: Property not found. retry in 799.508774ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7682024-12-12T04:00:18.513ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da
7692024-12-12T04:00:18.513ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7702024-12-12T04:00:18.513ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7712024-12-12T04:00:18.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6325471 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44785 req_id = 93646c7a-12d1-4e5d-bd4d-a52447351853 response_code = 204 uri = /omicron-zones
7722024-12-12T04:00:18.516ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:719
7732024-12-12T04:00:18.546ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7742024-12-12T04:00:18.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43023
7752024-12-12T04:00:18.555ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
7762024-12-12T04:00:18.555ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8566 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43023 req_id = 640172db-75e9-43dc-b437-4221bfd0e41d response_code = 500 uri = /timesync
7772024-12-12T04:00:18.557ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7782024-12-12T04:00:18.709ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7792024-12-12T04:00:18.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56882
7802024-12-12T04:00:20.898ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12893941750628343364 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7812024-12-12T04:00:21.088ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2874664735818390536 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7822024-12-12T04:00:21.425ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16880985184269292347 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7832024-12-12T04:00:22.542ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 663650057557475238 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7842024-12-12T04:00:22.542ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5155637728408535992 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7852024-12-12T04:00:22.718ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
7862024-12-12T04:00:22.718ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008052 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56882 req_id = 1c38540e-a90b-4f35-9c3f-aebffc621ed5 response_code = 500 uri = /timesync
7872024-12-12T04:00:22.720ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7882024-12-12T04:00:22.835ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7892024-12-12T04:00:22.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52354
7902024-12-12T04:00:22.844ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
7912024-12-12T04:00:22.844ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8959 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52354 req_id = c5fbc4f5-7e46-4f7f-8f8b-d3e274788435 response_code = 500 uri = /timesync
7922024-12-12T04:00:22.847ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7932024-12-12T04:00:22.974ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7942024-12-12T04:00:22.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56849
7952024-12-12T04:00:23.477ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7962024-12-12T04:00:23.478ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
7972024-12-12T04:00:26.687ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e93c7fbd-e5ba-471c-9eb8-f8ab296db8da': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
7982024-12-12T04:00:26.687ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56849 req_id = a2958369-c4ab-43cc-89b1-6cfb34da54d7 response_code = 500 uri = /timesync
7992024-12-12T04:00:26.690ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8002024-12-12T04:00:26.895ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8012024-12-12T04:00:26.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49784
8022024-12-12T04:00:26.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8744 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49784 req_id = b55c4e44-af15-4560-92ea-d54cf3cd3347 response_code = 200 uri = /timesync
8032024-12-12T04:00:26.906ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.412133694 } file = sled-agent/src/rack_setup/service.rs:727
8042024-12-12T04:00:26.906ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8052024-12-12T04:00:27.235ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8062024-12-12T04:00:27.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61129
8072024-12-12T04:00:27.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8978 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61129 req_id = 1d3ffb71-01df-4883-8fb8-6e80077abd0a response_code = 200 uri = /timesync
8082024-12-12T04:00:27.246ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.411210448 } file = sled-agent/src/rack_setup/service.rs:727
8092024-12-12T04:00:27.246ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8102024-12-12T04:00:27.497ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8112024-12-12T04:00:27.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54465
8122024-12-12T04:00:27.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8064 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54465 req_id = a0371a7c-98f7-4a27-8e48-ff06ae844e30 response_code = 200 uri = /timesync
8132024-12-12T04:00:27.507ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.410499901 } file = sled-agent/src/rack_setup/service.rs:727
8142024-12-12T04:00:27.507ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8152024-12-12T04:00:27.955ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8162024-12-12T04:00:27.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38849
8172024-12-12T04:00:27.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7598 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38849 req_id = 056030c8-07c0-465a-8d5f-42c5d4cbc26f response_code = 200 uri = /timesync
8182024-12-12T04:00:27.965ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.408447981 } file = sled-agent/src/rack_setup/service.rs:727
8192024-12-12T04:00:27.965ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8202024-12-12T04:00:28.217ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5009262033530654543 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8212024-12-12T04:00:28.217ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14345750565279419795 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8222024-12-12T04:00:28.411ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8232024-12-12T04:00:28.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57626
8242024-12-12T04:00:28.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7755 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57626 req_id = 1b88ee6a-a121-4a35-a88e-834e0c5c2d3c response_code = 200 uri = /timesync
8252024-12-12T04:00:28.421ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.40721041 } file = sled-agent/src/rack_setup/service.rs:727
8262024-12-12T04:00:28.421ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8272024-12-12T04:00:28.930ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8282024-12-12T04:00:28.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51809
8292024-12-12T04:00:28.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8463 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51809 req_id = 38fec04d-3dbd-4676-bae9-c20a1133e73c response_code = 200 uri = /timesync
8302024-12-12T04:00:28.941ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976028.164306, correction: -0.405790806 } file = sled-agent/src/rack_setup/service.rs:727
8312024-12-12T04:00:28.941ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8322024-12-12T04:00:29.540ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8332024-12-12T04:00:29.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33158
8342024-12-12T04:00:29.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7685 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33158 req_id = 5803f883-1700-450b-8e42-a66fd78291ad response_code = 200 uri = /timesync
8352024-12-12T04:00:29.550ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733976026.6319878, correction: -0.404137641 } file = sled-agent/src/rack_setup/service.rs:727
8362024-12-12T04:00:29.550ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8372024-12-12T04:00:29.960ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8382024-12-12T04:00:29.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60779
8392024-12-12T04:00:29.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8527 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60779 req_id = 62be4335-596a-4cb3-a31c-ecb13bef7432 response_code = 200 uri = /timesync
8402024-12-12T04:00:29.972ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976029.3105726, correction: -0.402751446 } file = sled-agent/src/rack_setup/service.rs:727
8412024-12-12T04:00:29.972ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8422024-12-12T04:00:30.526ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 296.097384ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8432024-12-12T04:00:30.595ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12893941750628343364 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8442024-12-12T04:00:30.783ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2874664735818390536 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8452024-12-12T04:00:31.072ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8462024-12-12T04:00:31.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40075
8472024-12-12T04:00:31.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8036 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40075 req_id = e4cb2184-485e-4c65-9ae1-207fcabde983 response_code = 200 uri = /timesync
8482024-12-12T04:00:31.083ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733976026.6319878, correction: -0.399533749 } file = sled-agent/src/rack_setup/service.rs:727
8492024-12-12T04:00:31.083ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8502024-12-12T04:00:31.121ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16880985184269292347 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8512024-12-12T04:00:31.614ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8522024-12-12T04:00:31.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61765
8532024-12-12T04:00:31.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61765 req_id = 33d9f8d8-e818-41dc-a7b7-45feae075b7a response_code = 200 uri = /timesync
8542024-12-12T04:00:31.623ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733976026.6319878, correction: -0.398066342 } file = sled-agent/src/rack_setup/service.rs:727
8552024-12-12T04:00:31.623ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8562024-12-12T04:00:32.234ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 663650057557475238 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8572024-12-12T04:00:32.234ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5155637728408535992 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8582024-12-12T04:00:32.325ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44789
8592024-12-12T04:00:32.325ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44789 req_id = 07aa2b9e-61b6-498a-9265-802b2d641ea8 response_code = 200 uri = /baseboard
8602024-12-12T04:00:33.054ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8612024-12-12T04:00:33.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52111
8622024-12-12T04:00:33.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52111 req_id = 7ed5a732-6e3a-4cac-a414-73a056668f84 response_code = 200 uri = /timesync
8632024-12-12T04:00:33.065ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976032.358564, correction: -0.394200921 } file = sled-agent/src/rack_setup/service.rs:727
8642024-12-12T04:00:33.065ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8652024-12-12T04:00:33.168ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8662024-12-12T04:00:33.168ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8672024-12-12T04:00:34.212ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8682024-12-12T04:00:34.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53748
8692024-12-12T04:00:34.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8372 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53748 req_id = 1320c778-fdde-422b-8fdd-2dee37af9a56 response_code = 200 uri = /timesync
8702024-12-12T04:00:34.222ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976033.3009934, correction: -0.390966296 } file = sled-agent/src/rack_setup/service.rs:727
8712024-12-12T04:00:34.222ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8722024-12-12T04:00:36.025ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8732024-12-12T04:00:36.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61649
8742024-12-12T04:00:36.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8419 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61649 req_id = ce5f21b1-b3c9-4127-9451-d8b435959c36 response_code = 200 uri = /timesync
8752024-12-12T04:00:36.036ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976035.050443, correction: -0.385808825 } file = sled-agent/src/rack_setup/service.rs:727
8762024-12-12T04:00:36.036ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8772024-12-12T04:00:38.210ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8782024-12-12T04:00:38.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63529
8792024-12-12T04:00:38.214ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5009262033530654543 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8802024-12-12T04:00:38.215ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14345750565279419795 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8812024-12-12T04:00:38.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63529 req_id = 19738ff5-9645-410c-b5f0-cc35342b73d7 response_code = 200 uri = /timesync
8822024-12-12T04:00:38.222ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976037.0678236, correction: -0.37981689 } file = sled-agent/src/rack_setup/service.rs:727
8832024-12-12T04:00:38.222ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8842024-12-12T04:00:40.491ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8852024-12-12T04:00:40.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53236
8862024-12-12T04:00:40.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53236 req_id = 7f21787b-965b-41c4-ae82-472f98270881 response_code = 200 uri = /timesync
8872024-12-12T04:00:40.502ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976039.3768847, correction: -0.373869032 } file = sled-agent/src/rack_setup/service.rs:727
8882024-12-12T04:00:40.502ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8892024-12-12T04:00:40.569ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12893941750628343364 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8902024-12-12T04:00:40.756ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2874664735818390536 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8912024-12-12T04:00:41.094ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16880985184269292347 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8922024-12-12T04:00:42.209ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 663650057557475238 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8932024-12-12T04:00:42.210ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5155637728408535992 sled_id = 80af691a-30bb-4399-8524-a68071b516df
8942024-12-12T04:00:42.352ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8952024-12-12T04:00:42.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64084
8962024-12-12T04:00:42.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64084 req_id = 3d3aea0e-b192-4d9f-8b57-2b89ac062478 response_code = 200 uri = /timesync
8972024-12-12T04:00:42.363ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976040.6364758, correction: -0.368760914 } file = sled-agent/src/rack_setup/service.rs:727
8982024-12-12T04:00:42.363ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8992024-12-12T04:00:43.143ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9002024-12-12T04:00:43.143ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9012024-12-12T04:00:45.815ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 484.950695ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9022024-12-12T04:00:46.360ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9032024-12-12T04:00:46.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56078
9042024-12-12T04:00:46.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8614 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56078 req_id = aece3eb3-1ff0-4405-a651-da11faa621a7 response_code = 200 uri = /timesync
9052024-12-12T04:00:46.372ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976044.712625, correction: -0.357860327 } file = sled-agent/src/rack_setup/service.rs:727
9062024-12-12T04:00:46.372ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9072024-12-12T04:00:48.189ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5009262033530654543 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9082024-12-12T04:00:48.189ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14345750565279419795 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9092024-12-12T04:00:50.545ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12893941750628343364 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9102024-12-12T04:00:50.730ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2874664735818390536 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9112024-12-12T04:00:51.068ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16880985184269292347 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9122024-12-12T04:00:51.396ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9132024-12-12T04:00:51.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47312
9142024-12-12T04:00:51.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8635 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47312 req_id = 2555b591-4b57-4809-a7db-36be95cfe852 response_code = 200 uri = /timesync
9152024-12-12T04:00:51.407ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976049.365505, correction: -0.344178408 } file = sled-agent/src/rack_setup/service.rs:727
9162024-12-12T04:00:51.407ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9172024-12-12T04:00:52.185ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 663650057557475238 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9182024-12-12T04:00:52.185ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5155637728408535992 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9192024-12-12T04:00:53.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9202024-12-12T04:00:53.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9212024-12-12T04:00:58.014ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9222024-12-12T04:00:58.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52955
9232024-12-12T04:00:58.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9751 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52955 req_id = 5eaa2fa2-750e-4f6a-9cf7-5f99645c2a76 response_code = 200 uri = /timesync
9242024-12-12T04:00:58.027ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976054.8354445, correction: -0.325875431 } file = sled-agent/src/rack_setup/service.rs:727
9252024-12-12T04:00:58.027ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9262024-12-12T04:00:58.165ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5009262033530654543 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9272024-12-12T04:00:58.165ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14345750565279419795 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9282024-12-12T04:01:00.519ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12893941750628343364 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9292024-12-12T04:01:00.705ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2874664735818390536 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9302024-12-12T04:01:01.042ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16880985184269292347 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9312024-12-12T04:01:01.293ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.488374082s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9322024-12-12T04:01:02.160ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 663650057557475238 reason = Duration(60s) sled_id = 80af691a-30bb-4399-8524-a68071b516df
9332024-12-12T04:01:02.160ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5155637728408535992 reason = Duration(60s) sled_id = 80af691a-30bb-4399-8524-a68071b516df
9342024-12-12T04:01:02.278ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39437
9352024-12-12T04:01:02.278ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39437 req_id = fbf572be-51d8-45f6-881c-c1f62aae03e6 response_code = 200 uri = /baseboard
9362024-12-12T04:01:03.094ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9372024-12-12T04:01:03.094ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9382024-12-12T04:01:05.931ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9392024-12-12T04:01:05.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58265
9402024-12-12T04:01:05.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58265 req_id = 57ba0c5f-271f-4cbe-af50-8f8151b42a7f response_code = 200 uri = /timesync
9412024-12-12T04:01:05.943ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976062.9470556, correction: -0.304351658 } file = sled-agent/src/rack_setup/service.rs:727
9422024-12-12T04:01:05.943ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9432024-12-12T04:01:08.140ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5009262033530654543 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9442024-12-12T04:01:08.140ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14345750565279419795 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9452024-12-12T04:01:10.494ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12893941750628343364 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9462024-12-12T04:01:10.679ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2874664735818390536 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9472024-12-12T04:01:11.016ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16880985184269292347 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9482024-12-12T04:01:13.068ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9492024-12-12T04:01:13.069ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9502024-12-12T04:01:15.230ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9512024-12-12T04:01:15.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35938
9522024-12-12T04:01:15.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9533 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35938 req_id = b4291ff4-8196-40af-803d-ce5b67f98af2 response_code = 200 uri = /timesync
9532024-12-12T04:01:15.243ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976071.461979, correction: -0.279276431 } file = sled-agent/src/rack_setup/service.rs:727
9542024-12-12T04:01:15.243ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9552024-12-12T04:01:17.771ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.531197838s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9562024-12-12T04:01:18.116ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5009262033530654543 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9572024-12-12T04:01:18.116ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14345750565279419795 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9582024-12-12T04:01:20.469ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12893941750628343364 reason = Duration(60s) sled_id = 80af691a-30bb-4399-8524-a68071b516df
9592024-12-12T04:01:20.653ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2874664735818390536 reason = Duration(60s) sled_id = 80af691a-30bb-4399-8524-a68071b516df
9602024-12-12T04:01:20.990ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16880985184269292347 reason = Duration(60s) sled_id = 80af691a-30bb-4399-8524-a68071b516df
9612024-12-12T04:01:23.043ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9622024-12-12T04:01:23.043ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9632024-12-12T04:01:26.717ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9642024-12-12T04:01:26.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42398
9652024-12-12T04:01:26.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8967 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42398 req_id = e8ae7b2e-dd67-40e5-8ae3-d7ec42f60370 response_code = 200 uri = /timesync
9662024-12-12T04:01:26.729ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976083.786115, correction: -0.247968048 } file = sled-agent/src/rack_setup/service.rs:727
9672024-12-12T04:01:26.729ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9682024-12-12T04:01:28.091ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5009262033530654543 reason = Duration(60s) sled_id = 80af691a-30bb-4399-8524-a68071b516df
9692024-12-12T04:01:28.092ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14345750565279419795 reason = Duration(60s) sled_id = 80af691a-30bb-4399-8524-a68071b516df
9702024-12-12T04:01:32.231ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47938
9712024-12-12T04:01:32.231ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47938 req_id = b03d3d99-6298-4998-b317-5da1fed2e353 response_code = 200 uri = /baseboard
9722024-12-12T04:01:33.018ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9732024-12-12T04:01:33.018ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9742024-12-12T04:01:34.033ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9752024-12-12T04:01:34.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34995
9762024-12-12T04:01:34.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8534 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34995 req_id = ab21025a-f2d1-47b6-b79f-f8c8d92a4be9 response_code = 200 uri = /timesync
9772024-12-12T04:01:34.043ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976091.8415132, correction: -0.228222102 } file = sled-agent/src/rack_setup/service.rs:727
9782024-12-12T04:01:34.043ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9792024-12-12T04:01:35.288ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.171213191s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9802024-12-12T04:01:40.836ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9812024-12-12T04:01:40.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62362
9822024-12-12T04:01:40.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10778 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62362 req_id = 52cec9b4-309d-4626-866e-f7d3a155db47 response_code = 200 uri = /timesync
9832024-12-12T04:01:40.849ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976099.749287, correction: -0.209694833 } file = sled-agent/src/rack_setup/service.rs:727
9842024-12-12T04:01:40.849ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9852024-12-12T04:01:42.993ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9862024-12-12T04:01:42.993ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9872024-12-12T04:01:52.968ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9882024-12-12T04:01:52.968ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9892024-12-12T04:01:54.442ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.413086347s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9902024-12-12T04:01:56.095ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9912024-12-12T04:01:56.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61793
9922024-12-12T04:01:56.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8979 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61793 req_id = 75333716-7903-409a-b104-0a0dc3a76796 response_code = 200 uri = /timesync
9932024-12-12T04:01:56.105ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976108.022206, correction: -0.168221235 } file = sled-agent/src/rack_setup/service.rs:727
9942024-12-12T04:01:56.106ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9952024-12-12T04:02:02.185ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36800
9962024-12-12T04:02:02.185ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36800 req_id = 3856e69c-e2df-4966-85af-f2cf89fb975f response_code = 200 uri = /baseboard
9972024-12-12T04:02:02.943ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9982024-12-12T04:02:02.943ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
9992024-12-12T04:02:04.912ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
10002024-12-12T04:02:04.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40513
10012024-12-12T04:02:04.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40513 req_id = d898a26d-b4f1-430f-a02f-1f22815f36ba response_code = 200 uri = /timesync
10022024-12-12T04:02:04.924ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976124.477355, correction: -0.144205317 } file = sled-agent/src/rack_setup/service.rs:727
10032024-12-12T04:02:04.924ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
10042024-12-12T04:02:12.918ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10052024-12-12T04:02:12.918ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10062024-12-12T04:02:15.833ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.126702947s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10072024-12-12T04:02:20.281ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
10082024-12-12T04:02:20.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58349
10092024-12-12T04:02:20.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8970 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58349 req_id = cddac40b-3eec-401c-82f5-b8ad8b47f36e response_code = 200 uri = /timesync
10102024-12-12T04:02:20.292ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976131.9888358, correction: -0.102513388 } file = sled-agent/src/rack_setup/service.rs:727
10112024-12-12T04:02:20.292ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
10122024-12-12T04:02:22.893ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10132024-12-12T04:02:22.894ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10142024-12-12T04:02:32.136ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38244
10152024-12-12T04:02:32.136ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38244 req_id = a7062413-72fd-4fa3-9432-5551d76fe336 response_code = 200 uri = /baseboard
10162024-12-12T04:02:32.868ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10172024-12-12T04:02:32.868ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10182024-12-12T04:02:38.933ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 40.688497797s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10192024-12-12T04:02:42.843ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16290649787771231731 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10202024-12-12T04:02:42.843ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8095708785527482734 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10212024-12-12T04:02:47.066ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
10222024-12-12T04:02:47.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56655
10232024-12-12T04:02:47.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20800 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56655 req_id = f09f7a78-7431-4db1-83e7-9119ee91cfcb response_code = 200 uri = /timesync
10242024-12-12T04:02:47.088ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T04:01:02.160041286Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 663650057557475238 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10252024-12-12T04:02:47.089ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T04:01:02.160729993Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5155637728408535992 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10262024-12-12T04:02:47.090ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T04:01:20.990848735Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16880985184269292347 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10272024-12-12T04:02:47.090ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T04:01:28.091888604Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5009262033530654543 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10282024-12-12T04:02:47.090ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T04:01:28.092182942Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14345750565279419795 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10292024-12-12T04:02:47.090ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T04:01:20.469511334Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12893941750628343364 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10302024-12-12T04:02:47.090ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T04:01:20.653530279Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2874664735818390536 sled_id = 80af691a-30bb-4399-8524-a68071b516df
10312024-12-12T04:02:47.092ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1757546723, ip_addr: 104.194.8.227, stratum: 3, ref_time: 1733976164.1059089, correction: -0.029653709 } file = sled-agent/src/rack_setup/service.rs:727
10322024-12-12T04:02:47.092ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1412
10332024-12-12T04:02:47.124ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28 (service), filesystem_pool: Some(ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d24a9d9f-7884-44e6-bf52-febe49c3b719 (service), filesystem_pool: Some(ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 68b92f4b-c208-4567-8395-96046a9b6c9a (service), filesystem_pool: Some(ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e93c7fbd-e5ba-471c-9eb8-f8ab296db8da (service), filesystem_pool: Some(ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 270d86f3-7e6c-4b65-b865-bb90b66ba1dd, kind: Service { id: e93c7fbd-e5ba-471c-9eb8-f8ab296db8da }, name: Name("ntp-e93c7fbd-e5ba-471c-9eb8-f8ab296db8da"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 148])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: ac3591c4-ccc2-4307-aeea-b50163451b2f (service), filesystem_pool: Some(ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External } } } }, OmicronZoneConfig { id: 17c89bdd-5900-491f-abd6-d521eaf749c6 (service), filesystem_pool: Some(ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External } } } }, OmicronZoneConfig { id: 942da74e-d056-486f-85c3-68c1dfad04c9 (service), filesystem_pool: Some(ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External } } } }, OmicronZoneConfig { id: c86ecb3b-eb85-417f-980a-16aeee4dd5a4 (service), filesystem_pool: Some(ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6cd219d0-3931-45ab-940b-d08ed0c59a25 (service), filesystem_pool: Some(ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
10342024-12-12T04:02:47.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62358
10352024-12-12T04:02:47.124ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10362024-12-12T04:02:47.124ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10372024-12-12T04:02:47.159ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d24a9d9f-7884-44e6-bf52-febe49c3b719, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10382024-12-12T04:02:47.159ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d24a9d9f-7884-44e6-bf52-febe49c3b719, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10392024-12-12T04:02:47.189ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 68b92f4b-c208-4567-8395-96046a9b6c9a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10402024-12-12T04:02:47.189ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 68b92f4b-c208-4567-8395-96046a9b6c9a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: InternalDns }, responder: ... }
10412024-12-12T04:02:47.223ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ac3591c4-ccc2-4307-aeea-b50163451b2f, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10422024-12-12T04:02:47.223ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ac3591c4-ccc2-4307-aeea-b50163451b2f, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10432024-12-12T04:02:47.258ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 17c89bdd-5900-491f-abd6-d521eaf749c6, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10442024-12-12T04:02:47.258ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 17c89bdd-5900-491f-abd6-d521eaf749c6, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10452024-12-12T04:02:47.289ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 942da74e-d056-486f-85c3-68c1dfad04c9, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10462024-12-12T04:02:47.289ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 942da74e-d056-486f-85c3-68c1dfad04c9, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Cockroach }, responder: ... }
10472024-12-12T04:02:47.320ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c86ecb3b-eb85-417f-980a-16aeee4dd5a4, dataset_name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10482024-12-12T04:02:47.320ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c86ecb3b-eb85-417f-980a-16aeee4dd5a4, dataset_name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10492024-12-12T04:02:47.352ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6cd219d0-3931-45ab-940b-d08ed0c59a25, dataset_name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10502024-12-12T04:02:47.352ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6cd219d0-3931-45ab-940b-d08ed0c59a25, dataset_name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10512024-12-12T04:02:47.382ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10522024-12-12T04:02:47.382ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-zones.json file = common/src/ledger.rs:177
10532024-12-12T04:02:47.382ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-zones.json file = common/src/ledger.rs:177
10542024-12-12T04:02:47.382ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10552024-12-12T04:02:47.460ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10562024-12-12T04:02:47.460ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10572024-12-12T04:02:47.461ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10582024-12-12T04:02:47.461ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10592024-12-12T04:02:47.461ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10602024-12-12T04:02:47.546ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25 file = illumos-utils/src/zone.rs:325
10612024-12-12T04:02:47.550ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f file = illumos-utils/src/zone.rs:325
10622024-12-12T04:02:47.554ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 file = illumos-utils/src/zone.rs:325
10632024-12-12T04:02:47.558ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9 file = illumos-utils/src/zone.rs:325
10642024-12-12T04:02:47.563ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4 file = illumos-utils/src/zone.rs:325
10652024-12-12T04:02:47.568ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25 file = illumos-utils/src/zone.rs:363
10662024-12-12T04:02:47.572ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f file = illumos-utils/src/zone.rs:363
10672024-12-12T04:02:47.576ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 file = illumos-utils/src/zone.rs:363
10682024-12-12T04:02:47.581ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9 file = illumos-utils/src/zone.rs:363
10692024-12-12T04:02:47.586ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4 file = illumos-utils/src/zone.rs:363
10702024-12-12T04:02:50.483ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='6cd219d0-3931-45ab-940b-d08ed0c59a25'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10712024-12-12T04:02:50.484ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
10722024-12-12T04:02:50.489ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='17c89bdd-5900-491f-abd6-d521eaf749c6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10732024-12-12T04:02:50.489ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
10742024-12-12T04:02:50.494ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='942da74e-d056-486f-85c3-68c1dfad04c9'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10752024-12-12T04:02:50.494ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
10762024-12-12T04:02:50.532ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ac3591c4-ccc2-4307-aeea-b50163451b2f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10772024-12-12T04:02:50.533ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
10782024-12-12T04:02:50.552ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c86ecb3b-eb85-417f-980a-16aeee4dd5a4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10792024-12-12T04:02:50.552ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
10802024-12-12T04:02:50.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 69.191444ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
10812024-12-12T04:02:50.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 72.97763ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
10822024-12-12T04:02:50.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9") failed: Property not found. retry in 46.409296ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
10832024-12-12T04:02:50.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 58.642214ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
10842024-12-12T04:02:50.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 27.333631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
10852024-12-12T04:02:50.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9") failed: Property not found. retry in 67.653203ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
10862024-12-12T04:02:50.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 64.263946ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
10872024-12-12T04:02:50.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 122.193423ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
10882024-12-12T04:02:51.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 74.610665ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
10892024-12-12T04:02:51.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9") failed: Property not found. retry in 195.247365ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
10902024-12-12T04:02:51.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 139.913698ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
10912024-12-12T04:02:51.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 139.045259ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
10922024-12-12T04:02:51.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 134.009692ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
10932024-12-12T04:02:51.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 141.754366ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
10942024-12-12T04:02:52.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9") failed: Property not found. retry in 294.592722ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
10952024-12-12T04:02:52.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 264.938518ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
10962024-12-12T04:02:53.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 411.417295ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
10972024-12-12T04:02:53.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 337.952701ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
10982024-12-12T04:02:53.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 529.56583ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
10992024-12-12T04:02:53.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9") failed: Property not found. retry in 981.771843ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
11002024-12-12T04:02:53.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 361.232052ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
11012024-12-12T04:02:53.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 428.254343ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11022024-12-12T04:02:53.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 1.05895894s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
11032024-12-12T04:02:54.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 933.537905ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
11042024-12-12T04:02:54.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 1.19751296s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11052024-12-12T04:02:54.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 1.103464613s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11062024-12-12T04:02:54.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9") failed: Property not found. retry in 1.253140399s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
11072024-12-12T04:02:54.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 971.908062ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
11082024-12-12T04:02:55.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 845.060638ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
11092024-12-12T04:02:55.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 1.13318572s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11102024-12-12T04:02:55.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 1.389352056s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11112024-12-12T04:02:55.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 960.52696ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
11122024-12-12T04:02:55.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9") failed: Property not found. retry in 1.009383892s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
11132024-12-12T04:02:55.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 880.24119ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
11142024-12-12T04:02:56.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 1.238499303s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11152024-12-12T04:02:56.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 1.495595354s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11162024-12-12T04:02:56.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 876.922019ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
11172024-12-12T04:02:56.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 1.42692676s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
11182024-12-12T04:02:56.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9") failed: Property not found. retry in 924.15554ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
11192024-12-12T04:02:57.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 1.159267198s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11202024-12-12T04:02:57.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 1.179545258s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
11212024-12-12T04:02:57.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9") failed: Property not found. retry in 1.499785229s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
11222024-12-12T04:02:58.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 840.187275ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11232024-12-12T04:02:58.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 529.609307ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
11242024-12-12T04:02:58.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 925.037571ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
11252024-12-12T04:02:58.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 622.72844ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11262024-12-12T04:02:58.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 1.154975823s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
11272024-12-12T04:02:59.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 1.162830031s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11282024-12-12T04:02:59.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9") failed: Property not found. retry in 1.041347298s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
11292024-12-12T04:02:59.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 797.616377ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11302024-12-12T04:02:59.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4") failed: Property not found. retry in 918.310586ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
11312024-12-12T04:03:00.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f") failed: Property not found. retry in 703.524237ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
11322024-12-12T04:03:00.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 665.293406ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11332024-12-12T04:03:00.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 1.439625161s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11342024-12-12T04:03:00.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 661.094783ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11352024-12-12T04:03:01.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 857.119157ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11362024-12-12T04:03:01.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 775.956151ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11372024-12-12T04:03:02.098ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50328
11382024-12-12T04:03:02.099ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50328 req_id = 38f28d34-b6f6-483f-a568-1d6febd11fab response_code = 200 uri = /baseboard
11392024-12-12T04:03:02.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 1.367874998s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11402024-12-12T04:03:02.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 1.295290578s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11412024-12-12T04:03:03.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 651.204701ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11422024-12-12T04:03:03.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 1.120035941s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11432024-12-12T04:03:04.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 569.426986ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11442024-12-12T04:03:05.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 882.696002ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11452024-12-12T04:03:05.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 680.374081ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11462024-12-12T04:03:05.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 933.809099ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11472024-12-12T04:03:05.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 1.302873667s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11482024-12-12T04:03:06.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 1.242653267s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11492024-12-12T04:03:07.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 990.242436ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11502024-12-12T04:03:07.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 612.37168ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11512024-12-12T04:03:08.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 685.951229ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11522024-12-12T04:03:08.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 705.337982ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11532024-12-12T04:03:08.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 562.68731ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11542024-12-12T04:03:09.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 1.389513368s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11552024-12-12T04:03:09.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 748.199066ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11562024-12-12T04:03:10.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 1.215155545s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11572024-12-12T04:03:10.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 842.919194ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11582024-12-12T04:03:11.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25") failed: Property not found. retry in 931.437292ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11592024-12-12T04:03:11.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6") failed: Property not found. retry in 1.313065351s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11602024-12-12T04:03:12.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_6cd219d0-3931-45ab-940b-d08ed0c59a25
11612024-12-12T04:03:12.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_ac3591c4-ccc2-4307-aeea-b50163451b2f
11622024-12-12T04:03:12.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6
11632024-12-12T04:03:12.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_942da74e-d056-486f-85c3-68c1dfad04c9
11642024-12-12T04:03:12.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_c86ecb3b-eb85-417f-980a-16aeee4dd5a4
11652024-12-12T04:03:12.912ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11662024-12-12T04:03:12.913ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11672024-12-12T04:03:12.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25822160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62358 req_id = 72e1370f-8bf0-4587-8100-3eebe6c57126 response_code = 204 uri = /omicron-zones
11682024-12-12T04:03:12.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35430
11692024-12-12T04:03:12.978ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28364 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35430 req_id = 22510c00-5e1a-4167-b832-c631e2287a2a response_code = 500 uri = /cockroachdb
11702024-12-12T04:03:12.979ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "22510c00-5e1a-4167-b832-c631e2287a2a", "content-length": "124", "date": "Thu, 12 Dec 2024 04:03:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "22510c00-5e1a-4167-b832-c631e2287a2a" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 62.654089ms
11712024-12-12T04:03:13.069ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26220 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35430 req_id = c4cfdecc-9bb3-469b-a961-6730d1ac06f9 response_code = 500 uri = /cockroachdb
11722024-12-12T04:03:13.069ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c4cfdecc-9bb3-469b-a961-6730d1ac06f9", "content-length": "124", "date": "Thu, 12 Dec 2024 04:03:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c4cfdecc-9bb3-469b-a961-6730d1ac06f9" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 69.748809ms
11732024-12-12T04:03:13.166ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25336 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35430 req_id = 7f7e93a9-6d9f-4623-9c1c-4fb61e68b44e response_code = 500 uri = /cockroachdb
11742024-12-12T04:03:13.166ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7f7e93a9-6d9f-4623-9c1c-4fb61e68b44e", "content-length": "124", "date": "Thu, 12 Dec 2024 04:03:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7f7e93a9-6d9f-4623-9c1c-4fb61e68b44e" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 151.597598ms
11752024-12-12T04:03:13.344ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25779 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35430 req_id = f0975af6-d886-4897-81c2-c4abcaa3e4f3 response_code = 500 uri = /cockroachdb
11762024-12-12T04:03:13.344ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f0975af6-d886-4897-81c2-c4abcaa3e4f3", "content-length": "124", "date": "Thu, 12 Dec 2024 04:03:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f0975af6-d886-4897-81c2-c4abcaa3e4f3" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 98.073341ms
11772024-12-12T04:03:13.469ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25190 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35430 req_id = e43971c4-4bd2-4dea-ae22-7477216ec7ab response_code = 500 uri = /cockroachdb
11782024-12-12T04:03:13.469ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e43971c4-4bd2-4dea-ae22-7477216ec7ab", "content-length": "124", "date": "Thu, 12 Dec 2024 04:03:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e43971c4-4bd2-4dea-ae22-7477216ec7ab" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 250.25599ms
11792024-12-12T04:03:13.746ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26038 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35430 req_id = 94cb8eca-5f37-46a3-a865-890310759650 response_code = 500 uri = /cockroachdb
11802024-12-12T04:03:13.746ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "94cb8eca-5f37-46a3-a865-890310759650", "content-length": "124", "date": "Thu, 12 Dec 2024 04:03:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "94cb8eca-5f37-46a3-a865-890310759650" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 306.149717ms
11812024-12-12T04:03:14.079ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25810 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35430 req_id = 9d8d4a02-bd2a-4186-9f4b-19647b95f0a7 response_code = 500 uri = /cockroachdb
11822024-12-12T04:03:14.080ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9d8d4a02-bd2a-4186-9f4b-19647b95f0a7", "content-length": "124", "date": "Thu, 12 Dec 2024 04:03:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9d8d4a02-bd2a-4186-9f4b-19647b95f0a7" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 242.86869ms
11832024-12-12T04:03:14.351ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26825 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35430 req_id = 69661570-73df-4a38-b55a-1ecacb3b6754 response_code = 500 uri = /cockroachdb
11842024-12-12T04:03:14.351ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "69661570-73df-4a38-b55a-1ecacb3b6754", "content-length": "124", "date": "Thu, 12 Dec 2024 04:03:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "69661570-73df-4a38-b55a-1ecacb3b6754" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 208.647107ms
11852024-12-12T04:03:14.587ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17c89bdd-5900-491f-abd6-d521eaf749c6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26900 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35430 req_id = bcbfb786-4f3b-47b2-b7be-35025df5f0ce response_code = 500 uri = /cockroachdb
11862024-12-12T04:03:14.587ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bcbfb786-4f3b-47b2-b7be-35025df5f0ce", "content-length": "124", "date": "Thu, 12 Dec 2024 04:03:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bcbfb786-4f3b-47b2-b7be-35025df5f0ce" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 599.183169ms
11872024-12-12T04:03:15.217ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3758
11882024-12-12T04:03:26.222ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
11892024-12-12T04:03:35.876ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
11902024-12-12T04:03:35.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20688343 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35430 req_id = 86ad5d02-0a5f-4f90-8161-7e4e9b038581 response_code = 204 uri = /cockroachdb
11912024-12-12T04:03:35.876ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35237
11922024-12-12T04:03:35.877ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35237 req_id = f0895346-5697-48c0-9f0c-edf6c1682247 response_code = 200 uri = /baseboard
11932024-12-12T04:03:35.943ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28 (service), filesystem_pool: Some(ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d24a9d9f-7884-44e6-bf52-febe49c3b719 (service), filesystem_pool: Some(ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 68b92f4b-c208-4567-8395-96046a9b6c9a (service), filesystem_pool: Some(ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e93c7fbd-e5ba-471c-9eb8-f8ab296db8da (service), filesystem_pool: Some(ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 270d86f3-7e6c-4b65-b865-bb90b66ba1dd, kind: Service { id: e93c7fbd-e5ba-471c-9eb8-f8ab296db8da }, name: Name("ntp-e93c7fbd-e5ba-471c-9eb8-f8ab296db8da"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 148])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: ac3591c4-ccc2-4307-aeea-b50163451b2f (service), filesystem_pool: Some(ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External } } } }, OmicronZoneConfig { id: 17c89bdd-5900-491f-abd6-d521eaf749c6 (service), filesystem_pool: Some(ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External } } } }, OmicronZoneConfig { id: 942da74e-d056-486f-85c3-68c1dfad04c9 (service), filesystem_pool: Some(ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External } } } }, OmicronZoneConfig { id: c86ecb3b-eb85-417f-980a-16aeee4dd5a4 (service), filesystem_pool: Some(ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6cd219d0-3931-45ab-940b-d08ed0c59a25 (service), filesystem_pool: Some(ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b (service), filesystem_pool: Some(ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 (service), filesystem_pool: Some(ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 1d05500b-26d9-4871-8794-d746af81cddf (service), filesystem_pool: Some(ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 (service), filesystem_pool: Some(ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af (service), filesystem_pool: Some(ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 987cdbf0-9703-44d8-809c-7fc661879e56 (service), filesystem_pool: Some(ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 286ceca1-7f09-4fe6-b531-9f5f373850ee (service), filesystem_pool: Some(ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8cb44ea6-bc28-4b69-9403-d2a1af99568e (service), filesystem_pool: Some(ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: dac44784-70a3-49f0-bd56-9b724ccc27cc (service), filesystem_pool: Some(ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 78444434-3b42-4723-9f32-a86c8bc7cfb1 (service), filesystem_pool: Some(ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: b158ad2f-896b-4cb1-a3f6-25308c7902f2 (service), filesystem_pool: Some(ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External } } } }, OmicronZoneConfig { id: 42e26c2e-2815-407e-a6c9-3347c4b92f39 (service), filesystem_pool: Some(ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External } } } }, OmicronZoneConfig { id: 089ac3bd-5acd-4d4a-b817-663df1ba5189 (service), filesystem_pool: Some(ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External } } } }, OmicronZoneConfig { id: c469e1af-57b9-4787-8577-1e177df6a4ab (service), filesystem_pool: Some(ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External } } } }, OmicronZoneConfig { id: 728110ff-542c-40c6-b380-d8fde116dad7 (service), filesystem_pool: Some(ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 74843ccf-cbc2-4321-a945-b796c2b7819b (service), filesystem_pool: Some(ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External } } } }, OmicronZoneConfig { id: f53f8a2e-1184-418d-8a44-73b6522b6def (service), filesystem_pool: Some(ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External } } } }, OmicronZoneConfig { id: af8098bd-1929-4d8b-aaa0-60e5901f96b3 (service), filesystem_pool: Some(ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External } } } }, OmicronZoneConfig { id: d15694ae-7c87-404e-950e-21580e1d390e (service), filesystem_pool: Some(ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
11942024-12-12T04:03:35.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57462
11952024-12-12T04:03:35.944ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11962024-12-12T04:03:35.944ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c9c9afd6-aa03-4a96-8241-6ae7ccfbce28, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11972024-12-12T04:03:35.995ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d24a9d9f-7884-44e6-bf52-febe49c3b719, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11982024-12-12T04:03:35.995ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d24a9d9f-7884-44e6-bf52-febe49c3b719, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11992024-12-12T04:03:36.047ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 68b92f4b-c208-4567-8395-96046a9b6c9a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12002024-12-12T04:03:36.047ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 68b92f4b-c208-4567-8395-96046a9b6c9a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: InternalDns }, responder: ... }
12012024-12-12T04:03:36.102ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ac3591c4-ccc2-4307-aeea-b50163451b2f, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12022024-12-12T04:03:36.102ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ac3591c4-ccc2-4307-aeea-b50163451b2f, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12032024-12-12T04:03:36.146ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 17c89bdd-5900-491f-abd6-d521eaf749c6, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12042024-12-12T04:03:36.146ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 17c89bdd-5900-491f-abd6-d521eaf749c6, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12052024-12-12T04:03:36.188ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 942da74e-d056-486f-85c3-68c1dfad04c9, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12062024-12-12T04:03:36.188ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 942da74e-d056-486f-85c3-68c1dfad04c9, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Cockroach }, responder: ... }
12072024-12-12T04:03:36.235ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c86ecb3b-eb85-417f-980a-16aeee4dd5a4, dataset_name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12082024-12-12T04:03:36.235ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c86ecb3b-eb85-417f-980a-16aeee4dd5a4, dataset_name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12092024-12-12T04:03:36.285ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6cd219d0-3931-45ab-940b-d08ed0c59a25, dataset_name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12102024-12-12T04:03:36.285ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6cd219d0-3931-45ab-940b-d08ed0c59a25, dataset_name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12112024-12-12T04:03:36.333ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12122024-12-12T04:03:36.333ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12132024-12-12T04:03:36.385ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12142024-12-12T04:03:36.385ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12152024-12-12T04:03:36.433ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 286ceca1-7f09-4fe6-b531-9f5f373850ee, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
12162024-12-12T04:03:36.433ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 286ceca1-7f09-4fe6-b531-9f5f373850ee, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12172024-12-12T04:03:36.478ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b158ad2f-896b-4cb1-a3f6-25308c7902f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12182024-12-12T04:03:36.478ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b158ad2f-896b-4cb1-a3f6-25308c7902f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, kind: Crucible }, responder: ... }
12192024-12-12T04:03:36.520ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 42e26c2e-2815-407e-a6c9-3347c4b92f39, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12202024-12-12T04:03:36.520ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 42e26c2e-2815-407e-a6c9-3347c4b92f39, dataset_name: DatasetName { pool_name: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, kind: Crucible }, responder: ... }
12212024-12-12T04:03:36.571ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 089ac3bd-5acd-4d4a-b817-663df1ba5189, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12222024-12-12T04:03:36.571ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 089ac3bd-5acd-4d4a-b817-663df1ba5189, dataset_name: DatasetName { pool_name: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, kind: Crucible }, responder: ... }
12232024-12-12T04:03:36.619ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c469e1af-57b9-4787-8577-1e177df6a4ab, dataset_name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12242024-12-12T04:03:36.619ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c469e1af-57b9-4787-8577-1e177df6a4ab, dataset_name: DatasetName { pool_name: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, kind: Crucible }, responder: ... }
12252024-12-12T04:03:36.666ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 728110ff-542c-40c6-b380-d8fde116dad7, dataset_name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12262024-12-12T04:03:36.666ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 728110ff-542c-40c6-b380-d8fde116dad7, dataset_name: DatasetName { pool_name: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, kind: Crucible }, responder: ... }
12272024-12-12T04:03:36.709ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 74843ccf-cbc2-4321-a945-b796c2b7819b, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12282024-12-12T04:03:36.709ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 74843ccf-cbc2-4321-a945-b796c2b7819b, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, kind: Crucible }, responder: ... }
12292024-12-12T04:03:36.750ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f53f8a2e-1184-418d-8a44-73b6522b6def, dataset_name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12302024-12-12T04:03:36.750ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f53f8a2e-1184-418d-8a44-73b6522b6def, dataset_name: DatasetName { pool_name: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, kind: Crucible }, responder: ... }
12312024-12-12T04:03:36.798ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: af8098bd-1929-4d8b-aaa0-60e5901f96b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12322024-12-12T04:03:36.798ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: af8098bd-1929-4d8b-aaa0-60e5901f96b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, kind: Crucible }, responder: ... }
12332024-12-12T04:03:36.845ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d15694ae-7c87-404e-950e-21580e1d390e, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12342024-12-12T04:03:36.846ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d15694ae-7c87-404e-950e-21580e1d390e, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, kind: Crucible }, responder: ... }
12352024-12-12T04:03:36.893ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12362024-12-12T04:03:36.893ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-zones.json file = common/src/ledger.rs:177
12372024-12-12T04:03:36.894ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-zones.json file = common/src/ledger.rs:177
12382024-12-12T04:03:36.894ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12392024-12-12T04:03:37.024ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12402024-12-12T04:03:37.024ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12412024-12-12T04:03:37.042ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12422024-12-12T04:03:37.042ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12432024-12-12T04:03:37.042ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12442024-12-12T04:03:37.042ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12452024-12-12T04:03:37.042ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12462024-12-12T04:03:37.068ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12472024-12-12T04:03:37.069ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12482024-12-12T04:03:37.070ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12492024-12-12T04:03:37.229ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12502024-12-12T04:03:37.231ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12512024-12-12T04:03:37.310ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12522024-12-12T04:03:37.310ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12532024-12-12T04:03:37.310ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12542024-12-12T04:03:37.310ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12552024-12-12T04:03:37.310ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12562024-12-12T04:03:37.310ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12572024-12-12T04:03:37.323ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12582024-12-12T04:03:37.323ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b file = illumos-utils/src/zone.rs:325
12592024-12-12T04:03:37.328ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56 file = illumos-utils/src/zone.rs:325
12602024-12-12T04:03:37.333ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee file = illumos-utils/src/zone.rs:325
12612024-12-12T04:03:37.337ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc file = illumos-utils/src/zone.rs:325
12622024-12-12T04:03:37.343ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1 file = illumos-utils/src/zone.rs:325
12632024-12-12T04:03:37.348ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2 file = illumos-utils/src/zone.rs:325
12642024-12-12T04:03:37.353ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7 file = illumos-utils/src/zone.rs:325
12652024-12-12T04:03:37.358ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e file = illumos-utils/src/zone.rs:325
12662024-12-12T04:03:37.484ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b file = illumos-utils/src/zone.rs:363
12672024-12-12T04:03:37.489ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56 file = illumos-utils/src/zone.rs:363
12682024-12-12T04:03:37.495ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee file = illumos-utils/src/zone.rs:363
12692024-12-12T04:03:37.500ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc file = illumos-utils/src/zone.rs:363
12702024-12-12T04:03:37.505ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1 file = illumos-utils/src/zone.rs:363
12712024-12-12T04:03:37.510ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2 file = illumos-utils/src/zone.rs:363
12722024-12-12T04:03:37.514ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7 file = illumos-utils/src/zone.rs:363
12732024-12-12T04:03:37.519ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e file = illumos-utils/src/zone.rs:363
12742024-12-12T04:03:37.524ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189 file = illumos-utils/src/zone.rs:325
12752024-12-12T04:03:37.531ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab file = illumos-utils/src/zone.rs:325
12762024-12-12T04:03:37.536ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39 file = illumos-utils/src/zone.rs:325
12772024-12-12T04:03:37.542ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3 file = illumos-utils/src/zone.rs:325
12782024-12-12T04:03:37.547ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def file = illumos-utils/src/zone.rs:325
12792024-12-12T04:03:37.554ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e file = illumos-utils/src/zone.rs:325
12802024-12-12T04:03:37.562ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189 file = illumos-utils/src/zone.rs:363
12812024-12-12T04:03:37.569ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab file = illumos-utils/src/zone.rs:363
12822024-12-12T04:03:37.577ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39 file = illumos-utils/src/zone.rs:363
12832024-12-12T04:03:37.585ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3 file = illumos-utils/src/zone.rs:363
12842024-12-12T04:03:37.595ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def file = illumos-utils/src/zone.rs:363
12852024-12-12T04:03:37.622ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e file = illumos-utils/src/zone.rs:363
12862024-12-12T04:03:37.705ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12872024-12-12T04:03:37.759ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12882024-12-12T04:03:37.762ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12892024-12-12T04:03:37.762ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12902024-12-12T04:03:37.813ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 249, 251]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12912024-12-12T04:03:37.813ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12922024-12-12T04:03:37.868ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12932024-12-12T04:03:37.926ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12942024-12-12T04:03:37.985ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12952024-12-12T04:03:37.987ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12962024-12-12T04:03:37.987ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12972024-12-12T04:03:38.043ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 228, 233]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12982024-12-12T04:03:38.043ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12992024-12-12T04:03:38.046ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13002024-12-12T04:03:38.046ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13012024-12-12T04:03:38.106ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 247, 168]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13022024-12-12T04:03:38.106ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
13032024-12-12T04:03:38.106ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
13042024-12-12T04:03:38.107ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
13052024-12-12T04:03:38.107ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13062024-12-12T04:03:38.107ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13072024-12-12T04:03:38.108ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13082024-12-12T04:03:38.108ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13092024-12-12T04:03:38.164ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 248, 60]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13102024-12-12T04:03:38.164ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13112024-12-12T04:03:38.166ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13122024-12-12T04:03:38.166ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13132024-12-12T04:03:38.224ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 230, 128]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13142024-12-12T04:03:38.224ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13152024-12-12T04:03:38.225ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13162024-12-12T04:03:38.227ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13172024-12-12T04:03:38.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13182024-12-12T04:03:38.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13192024-12-12T04:03:38.333ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13202024-12-12T04:03:38.333ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13212024-12-12T04:03:38.334ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b file = illumos-utils/src/zone.rs:325
13222024-12-12T04:03:38.346ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13232024-12-12T04:03:38.346ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13242024-12-12T04:03:38.347ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13252024-12-12T04:03:38.347ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13262024-12-12T04:03:38.347ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13272024-12-12T04:03:38.350ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13282024-12-12T04:03:38.350ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13292024-12-12T04:03:38.354ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13302024-12-12T04:03:38.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13312024-12-12T04:03:38.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13322024-12-12T04:03:38.405ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b file = illumos-utils/src/zone.rs:363
13332024-12-12T04:03:38.419ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115 file = illumos-utils/src/zone.rs:325
13342024-12-12T04:03:38.526ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373 file = illumos-utils/src/zone.rs:325
13352024-12-12T04:03:38.538ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115 file = illumos-utils/src/zone.rs:363
13362024-12-12T04:03:38.550ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf file = illumos-utils/src/zone.rs:325
13372024-12-12T04:03:38.561ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af file = illumos-utils/src/zone.rs:325
13382024-12-12T04:03:38.574ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373 file = illumos-utils/src/zone.rs:363
13392024-12-12T04:03:38.591ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf file = illumos-utils/src/zone.rs:363
13402024-12-12T04:03:38.601ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af file = illumos-utils/src/zone.rs:363
13412024-12-12T04:03:40.421ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422024-12-12T04:03:40.421ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
13432024-12-12T04:03:46.194ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='14ad6204-5a05-46a4-9391-0df1106c63b5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13442024-12-12T04:03:46.194ZINFOSledAgent (ServiceManager): Booting oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
13452024-12-12T04:03:46.241ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13462024-12-12T04:03:46.319ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
13472024-12-12T04:03:46.490ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='974c629a-ede0-4ebb-a7b6-8f59ae38218a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13482024-12-12T04:03:46.490ZINFOSledAgent (ServiceManager): Booting oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
13492024-12-12T04:03:46.541ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1b2f91f1-765c-426d-85c3-efd208c905ee'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13502024-12-12T04:03:46.543ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
13512024-12-12T04:03:46.563ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4b8ca783-c0e0-4c3f-a149-be038075af29/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4d1002fc-bc19-44d8-9819-d6c70dac89a4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13522024-12-12T04:03:46.563ZINFOSledAgent (ServiceManager): Booting oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
13532024-12-12T04:03:47.825ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13542024-12-12T04:03:47.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 38.904854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
13552024-12-12T04:03:47.844ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='987cdbf0-9703-44d8-809c-7fc661879e56'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13562024-12-12T04:03:47.844ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
13572024-12-12T04:03:47.855ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
13582024-12-12T04:03:47.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 57.476734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
13592024-12-12T04:03:47.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 40.237651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
13602024-12-12T04:03:47.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 70.051013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
13612024-12-12T04:03:47.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 144.317759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
13622024-12-12T04:03:48.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 188.805164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
13632024-12-12T04:03:48.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 134.997982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
13642024-12-12T04:03:48.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 42.41895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
13652024-12-12T04:03:48.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 49.184993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
13662024-12-12T04:03:48.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 53.173049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
13672024-12-12T04:03:48.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 234.783304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
13682024-12-12T04:03:48.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 111.883984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
13692024-12-12T04:03:48.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 58.778132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
13702024-12-12T04:03:48.223ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1674f1d0-50a0-49e8-aa22-8edb4b4e42aa'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13712024-12-12T04:03:48.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 110.145488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
13722024-12-12T04:03:48.242ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='adbef7e6-fb03-4d84-aef4-6963e8126143'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13732024-12-12T04:03:48.270ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1f24193c-b6a4-4e6c-b8b8-f49ad17750e8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13742024-12-12T04:03:48.271ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='259d0b4f-699a-4f00-aceb-f6fccf30f11a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13752024-12-12T04:03:48.271ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2ce90261-9b65-4601-b849-599cec034d39/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1e918d74-1981-40c9-a6c2-226abb21350d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13762024-12-12T04:03:48.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 64.477609ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
13772024-12-12T04:03:48.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 49.829445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
13782024-12-12T04:03:48.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 539.370241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
13792024-12-12T04:03:48.311ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
13802024-12-12T04:03:48.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 166.326991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
13812024-12-12T04:03:48.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 259.526175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
13822024-12-12T04:03:48.344ZINFOSledAgent (ServiceManager): Booting oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
13832024-12-12T04:03:48.352ZINFOSledAgent (ServiceManager): Booting oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
13842024-12-12T04:03:48.390ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
13852024-12-12T04:03:48.466ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13862024-12-12T04:03:48.466ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
13872024-12-12T04:03:48.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 245.595617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
13882024-12-12T04:03:48.531ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13892024-12-12T04:03:48.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 116.5458ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
13902024-12-12T04:03:48.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 79.238317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
13912024-12-12T04:03:48.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 246.265646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
13922024-12-12T04:03:48.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 224.098028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
13932024-12-12T04:03:48.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 284.537656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
13942024-12-12T04:03:48.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 326.95959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
13952024-12-12T04:03:48.634ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
13962024-12-12T04:03:48.643ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
13972024-12-12T04:03:48.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 217.03043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
13982024-12-12T04:03:48.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 294.686816ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
13992024-12-12T04:03:48.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 45.465741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
14002024-12-12T04:03:48.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 73.254425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
14012024-12-12T04:03:48.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 64.404611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
14022024-12-12T04:03:48.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 93.120899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
14032024-12-12T04:03:48.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 35.036838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
14042024-12-12T04:03:48.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 37.266007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
14052024-12-12T04:03:48.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 228.362071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
14062024-12-12T04:03:48.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 115.969095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
14072024-12-12T04:03:49.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 443.476094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
14082024-12-12T04:03:49.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 1.154794005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
14092024-12-12T04:03:49.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 283.3361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
14102024-12-12T04:03:49.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 511.305988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
14112024-12-12T04:03:49.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 413.634998ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
14122024-12-12T04:03:49.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 261.642201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
14132024-12-12T04:03:49.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 51.838261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
14142024-12-12T04:03:49.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 54.098749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
14152024-12-12T04:03:49.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 113.07221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
14162024-12-12T04:03:49.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 492.423419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
14172024-12-12T04:03:49.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 31.519226ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
14182024-12-12T04:03:49.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 404.823053ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
14192024-12-12T04:03:49.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 487.027809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
14202024-12-12T04:03:49.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 157.164163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
14212024-12-12T04:03:49.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 106.54661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
14222024-12-12T04:03:49.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 287.958657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
14232024-12-12T04:03:49.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 68.965444ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
14242024-12-12T04:03:49.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 160.29991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
14252024-12-12T04:03:49.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 138.229774ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
14262024-12-12T04:03:49.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 1.160907662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
14272024-12-12T04:03:49.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 295.711696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
14282024-12-12T04:03:49.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 128.605603ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
14292024-12-12T04:03:49.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 1.050057174s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
14302024-12-12T04:03:49.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 599.667127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
14312024-12-12T04:03:49.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 442.361462ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
14322024-12-12T04:03:49.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 272.532991ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
14332024-12-12T04:03:49.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 285.354432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
14342024-12-12T04:03:49.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 735.479073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
14352024-12-12T04:03:49.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 215.555149ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
14362024-12-12T04:03:49.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 1.337408033s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
14372024-12-12T04:03:49.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 592.968996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
14382024-12-12T04:03:49.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 915.60574ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
14392024-12-12T04:03:49.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 784.614142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
14402024-12-12T04:03:49.883ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14412024-12-12T04:03:49.883ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14422024-12-12T04:03:49.883ZINFOSledAgent (ServiceManager): Booting oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
14432024-12-12T04:03:49.894ZINFOSledAgent (ServiceManager): Booting oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
14442024-12-12T04:03:49.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 871.85582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
14452024-12-12T04:03:49.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 1.472724384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
14462024-12-12T04:03:49.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 368.709959ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
14472024-12-12T04:03:49.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 253.530885ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
14482024-12-12T04:03:50.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 580.09814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
14492024-12-12T04:03:50.015ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14502024-12-12T04:03:50.015ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
14512024-12-12T04:03:50.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 678.975524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
14522024-12-12T04:03:50.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 1.028082874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
14532024-12-12T04:03:50.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 1.166598748s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
14542024-12-12T04:03:50.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 1.09837043s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
14552024-12-12T04:03:50.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 51.064703ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
14562024-12-12T04:03:50.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 73.697977ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
14572024-12-12T04:03:50.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 879.01586ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
14582024-12-12T04:03:50.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 54.387896ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
14592024-12-12T04:03:50.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 72.929721ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
14602024-12-12T04:03:50.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 574.541965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
14612024-12-12T04:03:50.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 160.884338ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
14622024-12-12T04:03:50.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 1.21127782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
14632024-12-12T04:03:50.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 262.564915ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
14642024-12-12T04:03:50.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 34.894479ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
14652024-12-12T04:03:50.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 1.381019818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
14662024-12-12T04:03:50.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 1.42659564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
14672024-12-12T04:03:50.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 698.861375ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
14682024-12-12T04:03:50.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 444.934272ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
14692024-12-12T04:03:50.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 75.414098ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
14702024-12-12T04:03:50.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 999.285818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
14712024-12-12T04:03:50.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 1.031510548s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
14722024-12-12T04:03:50.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 577.259174ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
14732024-12-12T04:03:50.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 152.137152ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
14742024-12-12T04:03:50.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 673.453357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
14752024-12-12T04:03:50.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 568.790266ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
14762024-12-12T04:03:50.990ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 40.302969239s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80af691a-30bb-4399-8524-a68071b516df
14772024-12-12T04:03:51.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 285.697632ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
14782024-12-12T04:03:51.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 1.228954068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
14792024-12-12T04:03:51.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 1.237648662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
14802024-12-12T04:03:51.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 988.468969ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
14812024-12-12T04:03:51.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 973.817084ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
14822024-12-12T04:03:51.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 731.296363ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
14832024-12-12T04:03:51.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 686.351478ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
14842024-12-12T04:03:51.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 1.010850367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
14852024-12-12T04:03:51.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 1.271592367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
14862024-12-12T04:03:51.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 676.422789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
14872024-12-12T04:03:51.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 1.097427568s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
14882024-12-12T04:03:51.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 1.12384077s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
14892024-12-12T04:03:51.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 842.435115ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
14902024-12-12T04:03:51.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 1.495514403s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
14912024-12-12T04:03:51.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 1.14116341s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
14922024-12-12T04:03:51.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 1.211909669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
14932024-12-12T04:03:51.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 1.309725577s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
14942024-12-12T04:03:52.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 971.732687ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
14952024-12-12T04:03:52.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 522.131142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
14962024-12-12T04:03:52.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 1.221861875s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
14972024-12-12T04:03:52.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 1.47001014s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
14982024-12-12T04:03:52.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 944.378773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
14992024-12-12T04:03:52.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 1.020154811s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
15002024-12-12T04:03:52.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 1.48497546s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
15012024-12-12T04:03:52.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 1.178986809s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
15022024-12-12T04:03:52.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 1.252649847s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
15032024-12-12T04:03:52.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 1.203365042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
15042024-12-12T04:03:52.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 598.58219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
15052024-12-12T04:03:52.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 832.408588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
15062024-12-12T04:03:52.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 1.472346137s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
15072024-12-12T04:03:52.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 654.14764ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
15082024-12-12T04:03:52.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 1.308652758s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
15092024-12-12T04:03:52.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 933.866077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
15102024-12-12T04:03:53.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 1.331710601s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
15112024-12-12T04:03:53.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 853.21664ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
15122024-12-12T04:03:53.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 977.655246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
15132024-12-12T04:03:53.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 670.219775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
15142024-12-12T04:03:53.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 883.923834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
15152024-12-12T04:03:53.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 643.795676ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
15162024-12-12T04:03:53.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 1.415374041s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
15172024-12-12T04:03:53.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 1.424868101s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
15182024-12-12T04:03:53.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 660.78632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
15192024-12-12T04:03:53.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 1.444617683s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
15202024-12-12T04:03:53.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 990.899519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
15212024-12-12T04:03:53.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 933.308184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
15222024-12-12T04:03:53.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 1.110732019s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
15232024-12-12T04:03:53.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 547.185688ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
15242024-12-12T04:03:53.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 1.039512452s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
15252024-12-12T04:03:53.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 958.381331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
15262024-12-12T04:03:53.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 1.41322084s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
15272024-12-12T04:03:53.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 704.577074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
15282024-12-12T04:03:53.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 1.062030611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
15292024-12-12T04:03:54.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 1.295808747s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
15302024-12-12T04:03:54.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 505.722095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
15312024-12-12T04:03:54.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 1.345838334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
15322024-12-12T04:03:54.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 785.536746ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
15332024-12-12T04:03:54.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 1.252321224s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
15342024-12-12T04:03:54.168ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15352024-12-12T04:03:54.169ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
15362024-12-12T04:03:54.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 991.45184ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
15372024-12-12T04:03:54.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 1.300547613s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
15382024-12-12T04:03:54.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 63.981029ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
15392024-12-12T04:03:54.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 51.101192ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
15402024-12-12T04:03:54.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 1.436145917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
15412024-12-12T04:03:54.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 276.982639ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
15422024-12-12T04:03:54.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 1.190961153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
15432024-12-12T04:03:54.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 1.055750342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
15442024-12-12T04:03:54.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 1.29408435s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
15452024-12-12T04:03:54.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 578.026029ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
15462024-12-12T04:03:54.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 826.785815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
15472024-12-12T04:03:54.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 1.454503156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
15482024-12-12T04:03:54.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 899.765354ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
15492024-12-12T04:03:54.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 1.065894194s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
15502024-12-12T04:03:54.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 1.15380801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
15512024-12-12T04:03:54.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 853.520518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
15522024-12-12T04:03:54.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 484.5202ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
15532024-12-12T04:03:55.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 1.335786159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
15542024-12-12T04:03:55.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 1.164596125s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
15552024-12-12T04:03:55.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 1.014160946s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
15562024-12-12T04:03:55.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 586.969852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
15572024-12-12T04:03:55.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 1.411341432s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
15582024-12-12T04:03:55.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 904.734739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
15592024-12-12T04:03:55.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 685.581368ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
15602024-12-12T04:03:55.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 798.245433ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
15612024-12-12T04:03:55.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 677.59333ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
15622024-12-12T04:03:55.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 1.065271381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
15632024-12-12T04:03:55.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab") failed: Property not found. retry in 1.47229911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
15642024-12-12T04:03:55.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 948.980494ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
15652024-12-12T04:03:55.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 1.219027121s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
15662024-12-12T04:03:55.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 1.39283031s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
15672024-12-12T04:03:55.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 1.491526666s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
15682024-12-12T04:03:55.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 1.176870419s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
15692024-12-12T04:03:56.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 1.369783772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
15702024-12-12T04:03:56.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e") failed: Property not found. retry in 938.849316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
15712024-12-12T04:03:56.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc") failed: Property not found. retry in 1.369332485s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
15722024-12-12T04:03:56.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 573.757915ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
15732024-12-12T04:03:56.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 1.215975879s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
15742024-12-12T04:03:56.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 718.382033ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
15752024-12-12T04:03:56.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 1.264423885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
15762024-12-12T04:03:56.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 1.160591001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
15772024-12-12T04:03:56.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 662.430225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
15782024-12-12T04:03:56.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 1.318805771s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
15792024-12-12T04:03:56.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 1.167080693s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
15802024-12-12T04:03:56.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 761.284621ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
15812024-12-12T04:03:56.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 608.787804ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
15822024-12-12T04:03:56.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7") failed: Property not found. retry in 1.391855788s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
15832024-12-12T04:03:56.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 665.811537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
15842024-12-12T04:03:57.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56") failed: Property not found. retry in 925.082376ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
15852024-12-12T04:03:57.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1") failed: Property not found. retry in 887.751003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
15862024-12-12T04:03:57.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 1.37047905s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
15872024-12-12T04:03:57.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 968.349131ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
15882024-12-12T04:03:57.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 1.272008989s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
15892024-12-12T04:03:57.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 908.171317ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
15902024-12-12T04:03:57.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 736.928962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
15912024-12-12T04:03:57.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 1.037288236s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
15922024-12-12T04:03:57.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 899.340439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
15932024-12-12T04:03:57.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 1.235201632s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
15942024-12-12T04:03:57.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b") failed: Property not found. retry in 1.454813626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
15952024-12-12T04:03:57.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 707.543455ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
15962024-12-12T04:03:57.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 1.481659781s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
15972024-12-12T04:03:57.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 982.864322ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
15982024-12-12T04:03:57.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 626.720964ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
15992024-12-12T04:03:58.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 745.468702ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
16002024-12-12T04:03:58.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 849.393648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
16012024-12-12T04:03:58.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 538.55022ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
16022024-12-12T04:03:58.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 824.811591ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
16032024-12-12T04:03:58.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 1.141231079s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
16042024-12-12T04:03:58.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 1.325903746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
16052024-12-12T04:03:58.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 718.197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
16062024-12-12T04:03:58.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 1.00473512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
16072024-12-12T04:03:58.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 766.555902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
16082024-12-12T04:03:58.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 514.053818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
16092024-12-12T04:03:58.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 1.138453407s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
16102024-12-12T04:03:58.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 1.47198937s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
16112024-12-12T04:03:58.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 1.466303765s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
16122024-12-12T04:03:59.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 1.091634107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
16132024-12-12T04:03:59.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 1.148522645s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
16142024-12-12T04:03:59.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373") failed: Property not found. retry in 1.210588957s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
16152024-12-12T04:03:59.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 1.465897576s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
16162024-12-12T04:03:59.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 614.628662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
16172024-12-12T04:03:59.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 554.168465ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
16182024-12-12T04:03:59.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 1.480081407s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
16192024-12-12T04:03:59.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 944.826532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
16202024-12-12T04:03:59.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 781.200246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
16212024-12-12T04:03:59.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 516.091169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
16222024-12-12T04:03:59.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 915.189442ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
16232024-12-12T04:03:59.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189") failed: Property not found. retry in 736.693435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
16242024-12-12T04:04:00.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def") failed: Property not found. retry in 1.067974041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
16252024-12-12T04:04:00.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 535.44213ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
16262024-12-12T04:04:00.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 1.017763593s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
16272024-12-12T04:04:00.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b") failed: Property not found. retry in 1.433297113s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
16282024-12-12T04:04:00.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e") failed: Property not found. retry in 1.211537205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
16292024-12-12T04:04:00.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2") failed: Property not found. retry in 1.353652123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
16302024-12-12T04:04:00.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3") failed: Property not found. retry in 654.80483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
16312024-12-12T04:04:00.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39") failed: Property not found. retry in 1.380098868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
16322024-12-12T04:04:00.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf") failed: Property not found. retry in 1.335202447s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
16332024-12-12T04:04:00.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115") failed: Property not found. retry in 1.163969673s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
16342024-12-12T04:04:01.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af") failed: Property not found. retry in 621.390195ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
16352024-12-12T04:04:01.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 1.433221481s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
16362024-12-12T04:04:02.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee") failed: Property not found. retry in 1.421615152s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
16372024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_74843ccf-cbc2-4321-a945-b796c2b7819b
16382024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_9bb732d7-5c6c-418e-9bb4-2b78363c496b
16392024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_987cdbf0-9703-44d8-809c-7fc661879e56
16402024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_286ceca1-7f09-4fe6-b531-9f5f373850ee
16412024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_dac44784-70a3-49f0-bd56-9b724ccc27cc
16422024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_78444434-3b42-4723-9f32-a86c8bc7cfb1
16432024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_5a2da4c3-1dce-4828-9073-a93ecc67e115
16442024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_b158ad2f-896b-4cb1-a3f6-25308c7902f2
16452024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_728110ff-542c-40c6-b380-d8fde116dad7
16462024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_8cb44ea6-bc28-4b69-9403-d2a1af99568e
16472024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_1d05500b-26d9-4871-8794-d746af81cddf
16482024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_4a50bf12-1fdc-4917-8d03-ca85c9fb72af
16492024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_089ac3bd-5acd-4d4a-b817-663df1ba5189
16502024-12-12T04:04:04.247ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_c469e1af-57b9-4787-8577-1e177df6a4ab
16512024-12-12T04:04:04.248ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_42e26c2e-2815-407e-a6c9-3347c4b92f39
16522024-12-12T04:04:04.248ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_af8098bd-1929-4d8b-aaa0-60e5901f96b3
16532024-12-12T04:04:04.248ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_f53f8a2e-1184-418d-8a44-73b6522b6def
16542024-12-12T04:04:04.248ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_a6e7ea12-5d7a-4497-b4c7-99b34dca3373
16552024-12-12T04:04:04.248ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_d15694ae-7c87-404e-950e-21580e1d390e
16562024-12-12T04:04:04.268ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16572024-12-12T04:04:04.272ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16582024-12-12T04:04:04.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28371155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57462 req_id = 3f7f9c0d-a5b3-4192-8813-b62ba71fec23 response_code = 204 uri = /omicron-zones
16592024-12-12T04:04:04.325ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1435
16602024-12-12T04:04:04.325ZINFOSledAgent (RSS): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16612024-12-12T04:04:04.325ZINFOSledAgent (RSS): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16622024-12-12T04:04:04.337ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:774
16632024-12-12T04:04:04.338ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:786
16642024-12-12T04:04:04.377ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1000
16652024-12-12T04:04:04.610ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16662024-12-12T04:04:04.722ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16672024-12-12T04:04:04.865ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16682024-12-12T04:04:05.044ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16692024-12-12T04:04:05.254ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16702024-12-12T04:04:05.513ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16712024-12-12T04:04:05.661ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16722024-12-12T04:04:05.872ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16732024-12-12T04:04:05.948ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46176
16742024-12-12T04:04:05.956ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1509 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46176 req_id = b91e4e7b-6b53-44ba-b35b-df96fd66428a response_code = 200 uri = /baseboard
16752024-12-12T04:04:06.096ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16762024-12-12T04:04:06.731ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16772024-12-12T04:04:07.354ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16782024-12-12T04:04:08.100ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16792024-12-12T04:04:08.847ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1612ec8d-a72c-445a-999f-274daa8c155e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16802024-12-12T04:04:11.281ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "95c08437-ad24-448a-81dd-2e0913c0f9ee", "content-length": "173", "date": "Thu, 12 Dec 2024 04:04:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"1612ec8d-a72c-445a-999f-274daa8c155e\"", request_id: "95c08437-ad24-448a-81dd-2e0913c0f9ee" } file = sled-agent/src/rack_setup/service.rs:1062
16812024-12-12T04:04:11.885ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "091101dd-5a34-47d9-adb4-407dd31d0050", "content-length": "173", "date": "Thu, 12 Dec 2024 04:04:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"1612ec8d-a72c-445a-999f-274daa8c155e\"", request_id: "091101dd-5a34-47d9-adb4-407dd31d0050" } file = sled-agent/src/rack_setup/service.rs:1062
16822024-12-12T04:04:12.703ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "aa354826-c204-4169-9883-866c517bc610", "content-length": "173", "date": "Thu, 12 Dec 2024 04:04:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"1612ec8d-a72c-445a-999f-274daa8c155e\"", request_id: "aa354826-c204-4169-9883-866c517bc610" } file = sled-agent/src/rack_setup/service.rs:1062
16832024-12-12T04:04:13.886ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0fabd152-7994-4804-951e-c5ad78db0ef3", "content-length": "173", "date": "Thu, 12 Dec 2024 04:04:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"1612ec8d-a72c-445a-999f-274daa8c155e\"", request_id: "0fabd152-7994-4804-951e-c5ad78db0ef3" } file = sled-agent/src/rack_setup/service.rs:1062
16842024-12-12T04:04:16.084ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4b21f774-1d0f-445d-8a7c-8702d14ccc63", "content-length": "173", "date": "Thu, 12 Dec 2024 04:04:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80af691a-30bb-4399-8524-a68071b516df\"", request_id: "4b21f774-1d0f-445d-8a7c-8702d14ccc63" } file = sled-agent/src/rack_setup/service.rs:1062
16852024-12-12T04:04:18.320ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 80af691a-30bb-4399-8524-a68071b516df
16862024-12-12T04:04:18.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63029
16872024-12-12T04:04:18.406ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16882024-12-12T04:04:18.406ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16892024-12-12T04:04:18.406ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-zones.json file = common/src/ledger.rs:177
16902024-12-12T04:04:18.407ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-zones.json file = common/src/ledger.rs:177
16912024-12-12T04:04:18.422ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16922024-12-12T04:04:18.422ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071
16932024-12-12T04:04:18.446ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16942024-12-12T04:04:18.446ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46
16952024-12-12T04:04:18.466ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16962024-12-12T04:04:18.466ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb
16972024-12-12T04:04:18.492ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16982024-12-12T04:04:18.492ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47
16992024-12-12T04:04:18.516ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17002024-12-12T04:04:18.516ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4
17012024-12-12T04:04:18.539ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17022024-12-12T04:04:18.539ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4b8ca783-c0e0-4c3f-a149-be038075af29
17032024-12-12T04:04:18.562ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17042024-12-12T04:04:18.562ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2
17052024-12-12T04:04:18.588ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17062024-12-12T04:04:18.588ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f
17072024-12-12T04:04:18.611ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17082024-12-12T04:04:18.611ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2ce90261-9b65-4601-b849-599cec034d39
17092024-12-12T04:04:18.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220067 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63029 req_id = bc0b55a2-c923-4339-aa76-0bf0bd02d1d0 response_code = 200 uri = /inventory
17102024-12-12T04:04:19.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36178
17112024-12-12T04:04:19.585ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17122024-12-12T04:04:19.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17132024-12-12T04:04:19.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17142024-12-12T04:04:19.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17152024-12-12T04:04:19.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17162024-12-12T04:04:19.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17172024-12-12T04:04:19.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17182024-12-12T04:04:19.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3675 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36178 req_id = 3a30c947-c390-4c7d-92b8-ed218652f7ad response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17192024-12-12T04:04:19.586ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1072
17202024-12-12T04:04:19.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48114
17212024-12-12T04:04:19.919ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17222024-12-12T04:04:19.919ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17232024-12-12T04:04:19.919ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-zones.json file = common/src/ledger.rs:177
17242024-12-12T04:04:19.919ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-zones.json file = common/src/ledger.rs:177
17252024-12-12T04:04:19.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47408
17262024-12-12T04:04:19.928ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17272024-12-12T04:04:19.929ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17282024-12-12T04:04:19.929ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17292024-12-12T04:04:19.929ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17302024-12-12T04:04:19.929ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17312024-12-12T04:04:19.929ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17322024-12-12T04:04:19.929ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17332024-12-12T04:04:19.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 552 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47408 req_id = 929a0e74-4610-4a5c-b920-f999f138f589 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17342024-12-12T04:04:19.930ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17352024-12-12T04:04:19.930ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071
17362024-12-12T04:04:19.956ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17372024-12-12T04:04:19.956ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46
17382024-12-12T04:04:19.980ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17392024-12-12T04:04:19.980ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb
17402024-12-12T04:04:20.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51878
17412024-12-12T04:04:20.002ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17422024-12-12T04:04:20.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17432024-12-12T04:04:20.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17442024-12-12T04:04:20.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17452024-12-12T04:04:20.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17462024-12-12T04:04:20.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17472024-12-12T04:04:20.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17482024-12-12T04:04:20.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51878 req_id = 79cb52c0-a453-450a-8a33-187e398d11f5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17492024-12-12T04:04:20.006ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17502024-12-12T04:04:20.006ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47
17512024-12-12T04:04:20.029ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17522024-12-12T04:04:20.029ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4
17532024-12-12T04:04:20.051ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17542024-12-12T04:04:20.051ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4b8ca783-c0e0-4c3f-a149-be038075af29
17552024-12-12T04:04:20.072ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17562024-12-12T04:04:20.072ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2
17572024-12-12T04:04:20.094ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17582024-12-12T04:04:20.094ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f
17592024-12-12T04:04:20.114ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17602024-12-12T04:04:20.114ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2ce90261-9b65-4601-b849-599cec034d39
17612024-12-12T04:04:20.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209422 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48114 req_id = ba368ab5-9e0a-4ddb-9461-277f62ff146c response_code = 200 uri = /inventory
17622024-12-12T04:04:20.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43001
17632024-12-12T04:04:20.890ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17642024-12-12T04:04:20.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17652024-12-12T04:04:20.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17662024-12-12T04:04:20.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17672024-12-12T04:04:20.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17682024-12-12T04:04:20.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17692024-12-12T04:04:20.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17702024-12-12T04:04:20.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43001 req_id = bcfeaafd-15ab-4916-a595-bed7843376c0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17712024-12-12T04:04:27.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36357
17722024-12-12T04:04:27.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36357 req_id = cdac1b9f-db44-44d4-ba63-c805b4e738a4 response_code = 200 uri = /vpc-routes
17732024-12-12T04:04:27.827ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
17742024-12-12T04:04:27.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36357 req_id = 88947ad4-66ec-449c-8a43-e384f0554d2b response_code = 204 uri = /eip-gateways
17752024-12-12T04:04:27.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3565 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36357 req_id = 35fc9664-2350-4a9c-abaa-0e6c5920e75f response_code = 204 uri = /vpc-routes
17762024-12-12T04:04:35.996ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49096
17772024-12-12T04:04:35.996ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49096 req_id = 9304153c-b758-4fbc-8819-574ca7382e18 response_code = 200 uri = /baseboard
17782024-12-12T04:04:39.060ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:43012 remote_addr = [fd00:1122:3344:101::d]:42324 sled_id = 80af691a-30bb-4399-8524-a68071b516df
17792024-12-12T04:04:39.079ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18870 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = fa980a88-860e-4623-8cc1-b337f08e4519 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
17802024-12-12T04:04:42.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63448
17812024-12-12T04:04:42.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63448 req_id = 09e48eeb-6d43-4be9-b562-cb542be020ba response_code = 200 uri = /vpc-routes
17822024-12-12T04:04:42.996ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
17832024-12-12T04:04:42.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63448 req_id = bd8c8a9a-d6d7-487c-8dd8-a6a788d53fd7 response_code = 204 uri = /eip-gateways
17842024-12-12T04:04:43.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63448 req_id = c0e4bab7-6f0a-45ea-9376-ed76e969da45 response_code = 204 uri = /vpc-routes
17852024-12-12T04:04:43.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42767
17862024-12-12T04:04:43.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 849 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42767 req_id = 9694c9e5-366b-4fec-9c75-dc56c3bc690f response_code = 200 uri = /v2p
17872024-12-12T04:04:43.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62060
17882024-12-12T04:04:43.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17892024-12-12T04:04:43.345ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17902024-12-12T04:04:43.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109213 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62060 req_id = 703e3005-b7ee-46b1-8050-cd663c957eb4 response_code = 204 uri = /switch-ports
17912024-12-12T04:04:43.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62060 req_id = 9b1b69d3-26b8-413d-bb53-2ff0f0288315 response_code = 200 uri = /network-bootstore-config
17922024-12-12T04:04:43.448ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17932024-12-12T04:04:43.452ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17942024-12-12T04:04:43.454ZINFOSledAgent (bootstore): Writing ledger to /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17952024-12-12T04:04:43.459ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17962024-12-12T04:04:43.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10672 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62060 req_id = 96c58f5d-4d16-4aae-870c-6d35266d922a response_code = 204 uri = /network-bootstore-config
17972024-12-12T04:04:43.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41195
17982024-12-12T04:04:43.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41195 req_id = 4fe05a44-e06c-42e5-ad8e-b19bb4962520 response_code = 200 uri = /vpc-routes
17992024-12-12T04:04:43.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62742
18002024-12-12T04:04:43.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62742 req_id = 445d9c88-2041-45c0-bf12-43480a513812 response_code = 200 uri = /v2p
18012024-12-12T04:04:43.980ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
18022024-12-12T04:04:43.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41195 req_id = 53ee1e40-e7f3-4b00-b68c-afac105831ce response_code = 204 uri = /eip-gateways
18032024-12-12T04:04:43.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41195 req_id = f04dd1ad-7d79-496b-bfec-38725a77c8ea response_code = 204 uri = /vpc-routes
18042024-12-12T04:04:43.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34636
18052024-12-12T04:04:43.999ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18062024-12-12T04:04:44.037ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18072024-12-12T04:04:44.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92965 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34636 req_id = 42f9c71d-3c74-4af6-8653-445cd9fc252c response_code = 204 uri = /switch-ports
18082024-12-12T04:04:44.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34636 req_id = ab3f3cd5-1d0e-4d31-9bf5-c3140a9c0c38 response_code = 200 uri = /network-bootstore-config
18092024-12-12T04:04:44.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53395
18102024-12-12T04:04:44.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53395 req_id = 0af3aa90-d7e1-414f-a1a3-1f8129e10c74 response_code = 200 uri = /vpc-routes
18112024-12-12T04:04:44.565ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
18122024-12-12T04:04:44.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53395 req_id = 6dbda2c5-5095-4ef6-93dc-1b5071eafa44 response_code = 204 uri = /eip-gateways
18132024-12-12T04:04:44.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53395 req_id = 6f7b32ae-8554-44eb-a70d-5473a34c3b6d response_code = 204 uri = /vpc-routes
18142024-12-12T04:04:44.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38020
18152024-12-12T04:04:44.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38020 req_id = 3d0f6d53-3816-4a93-a2c7-bd3787d367dd response_code = 200 uri = /v2p
18162024-12-12T04:04:44.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45085
18172024-12-12T04:04:44.671ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18182024-12-12T04:04:44.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18192024-12-12T04:04:44.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45085 req_id = b0a34c32-de97-4b8e-96eb-806d923eaf22 response_code = 204 uri = /switch-ports
18202024-12-12T04:04:44.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45085 req_id = 94f8c2df-25cd-4929-99c4-5342250b812d response_code = 200 uri = /network-bootstore-config
18212024-12-12T04:04:55.872ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18222024-12-12T04:05:06.034ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58897
18232024-12-12T04:05:06.034ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58897 req_id = a98aa221-9dd4-4b4c-a6fb-0151691670be response_code = 200 uri = /baseboard
18242024-12-12T04:05:08.918ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7850 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = 04cb09cb-a7e0-46ba-8fa2-4127160636d1 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
18252024-12-12T04:05:13.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58219
18262024-12-12T04:05:13.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58219 req_id = 79f92c4f-db24-4c73-8c48-04e4315b6171 response_code = 200 uri = /vpc-routes
18272024-12-12T04:05:13.040ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
18282024-12-12T04:05:13.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58219 req_id = 4c471e3a-3d93-4b25-9689-2dae435b99b3 response_code = 204 uri = /eip-gateways
18292024-12-12T04:05:13.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58219 req_id = 85270551-aa85-4dde-910a-dd1eae699830 response_code = 204 uri = /vpc-routes
18302024-12-12T04:05:13.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34004
18312024-12-12T04:05:13.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34004 req_id = a57976e3-4356-4391-8942-dfe7469599df response_code = 200 uri = /v2p
18322024-12-12T04:05:13.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50688
18332024-12-12T04:05:13.472ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18342024-12-12T04:05:13.510ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18352024-12-12T04:05:13.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95190 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50688 req_id = 6df718dd-64cb-4494-bdfa-62e676e9a449 response_code = 204 uri = /switch-ports
18362024-12-12T04:05:13.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50688 req_id = f0797053-2ed3-4e25-a2a0-e0e49f2a788a response_code = 200 uri = /network-bootstore-config
18372024-12-12T04:05:13.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55680
18382024-12-12T04:05:13.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55680 req_id = 51d1206c-130c-4cf0-b254-1ebdbe992017 response_code = 200 uri = /vpc-routes
18392024-12-12T04:05:13.965ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
18402024-12-12T04:05:13.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55680 req_id = 71094673-cda1-41f6-880f-180bedb6d19b response_code = 204 uri = /eip-gateways
18412024-12-12T04:05:13.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55680 req_id = 81367529-627c-4236-af39-a7c400a5dbb0 response_code = 204 uri = /vpc-routes
18422024-12-12T04:05:14.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45330
18432024-12-12T04:05:14.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45330 req_id = c8a1ef9d-e22c-4758-b518-3673faa3070b response_code = 200 uri = /v2p
18442024-12-12T04:05:14.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43991
18452024-12-12T04:05:14.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18462024-12-12T04:05:14.367ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18472024-12-12T04:05:14.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127993 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43991 req_id = b0327775-4a6d-4ca9-9ab5-48eb83e313de response_code = 204 uri = /switch-ports
18482024-12-12T04:05:14.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43991 req_id = 93446e8d-2894-45b0-ad7d-3dbaf44913e9 response_code = 200 uri = /network-bootstore-config
18492024-12-12T04:05:14.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42061
18502024-12-12T04:05:14.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42061 req_id = 8a3cf31b-cfa4-4244-8bf3-fa8a53a1057d response_code = 200 uri = /vpc-routes
18512024-12-12T04:05:14.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
18522024-12-12T04:05:14.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42061 req_id = 46cf54a7-aa59-4ee8-a28e-da8afe8048f6 response_code = 204 uri = /eip-gateways
18532024-12-12T04:05:14.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42061 req_id = 826a2684-d51d-4bb6-b12a-7a3f55e7b320 response_code = 204 uri = /vpc-routes
18542024-12-12T04:05:14.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63512
18552024-12-12T04:05:14.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63512 req_id = c66b8020-6543-4fd4-9df7-690e423ec111 response_code = 200 uri = /v2p
18562024-12-12T04:05:14.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44504
18572024-12-12T04:05:14.823ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18582024-12-12T04:05:14.856ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18592024-12-12T04:05:14.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87180 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44504 req_id = d327301c-c04d-4170-9185-36466b4aa9db response_code = 204 uri = /switch-ports
18602024-12-12T04:05:14.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44504 req_id = 48204ca7-dc72-4a8e-b4ec-3c60a1fa2265 response_code = 200 uri = /network-bootstore-config
18612024-12-12T04:05:36.066ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46700
18622024-12-12T04:05:36.066ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46700 req_id = c2105e14-b2a9-4c19-ade5-72be7508cff4 response_code = 200 uri = /baseboard
18632024-12-12T04:05:38.917ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5964 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = de6052df-b387-41c9-acd3-4bcefdc149e0 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
18642024-12-12T04:05:42.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48499
18652024-12-12T04:05:42.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48499 req_id = 0e49ba06-3cc6-4937-9eb0-cb10af9d3a80 response_code = 200 uri = /vpc-routes
18662024-12-12T04:05:42.856ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
18672024-12-12T04:05:42.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48499 req_id = 12ab3e69-ecea-4203-8194-233899442ae3 response_code = 204 uri = /eip-gateways
18682024-12-12T04:05:42.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48499 req_id = 1cfdfe8f-8359-44c9-b2e0-cf8da96677bd response_code = 204 uri = /vpc-routes
18692024-12-12T04:05:42.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62898
18702024-12-12T04:05:42.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62898 req_id = d3308739-7726-4a5e-95cb-bbf39efedb0f response_code = 200 uri = /v2p
18712024-12-12T04:05:43.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34763
18722024-12-12T04:05:43.010ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18732024-12-12T04:05:43.047ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18742024-12-12T04:05:43.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34763 req_id = ea201f15-9ca4-4049-a678-111bf47de927 response_code = 204 uri = /switch-ports
18752024-12-12T04:05:43.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34763 req_id = e6a5dcc0-203c-4bad-86da-273b700c8784 response_code = 200 uri = /network-bootstore-config
18762024-12-12T04:05:43.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60671
18772024-12-12T04:05:43.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60671 req_id = 683a3809-1d78-4164-9e42-2b83ecf11e66 response_code = 200 uri = /vpc-routes
18782024-12-12T04:05:43.928ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
18792024-12-12T04:05:43.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60671 req_id = a2f778e1-da03-4899-ac02-960ee02b047c response_code = 204 uri = /eip-gateways
18802024-12-12T04:05:43.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60671 req_id = 1dc36172-d7da-4c97-b93f-f2dca51b33b2 response_code = 204 uri = /vpc-routes
18812024-12-12T04:05:43.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64954
18822024-12-12T04:05:43.953ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18832024-12-12T04:05:43.990ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18842024-12-12T04:05:44.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90059 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64954 req_id = 76ade901-3f99-4bdc-9a5c-8eb69edf79f1 response_code = 204 uri = /switch-ports
18852024-12-12T04:05:44.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60657
18862024-12-12T04:05:44.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64954 req_id = ca5c849c-a22a-420b-aa20-a014bd103898 response_code = 200 uri = /network-bootstore-config
18872024-12-12T04:05:44.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60657 req_id = e502638e-0e32-43d4-b552-6d8452e01f17 response_code = 200 uri = /v2p
18882024-12-12T04:05:44.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47994
18892024-12-12T04:05:44.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47994 req_id = 11280afc-046b-47a4-ac98-1c565b648fd1 response_code = 200 uri = /vpc-routes
18902024-12-12T04:05:44.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65045
18912024-12-12T04:05:44.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65045 req_id = c1b3b317-21bd-4631-a756-bc9aa9de962c response_code = 200 uri = /v2p
18922024-12-12T04:05:44.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
18932024-12-12T04:05:44.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47994 req_id = 553ebf89-3b43-4f16-9fab-470961816b03 response_code = 204 uri = /eip-gateways
18942024-12-12T04:05:44.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47994 req_id = 50e68ce6-86d6-4408-8b17-88f3653ce238 response_code = 204 uri = /vpc-routes
18952024-12-12T04:05:44.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59200
18962024-12-12T04:05:44.683ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18972024-12-12T04:05:44.723ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18982024-12-12T04:05:44.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97022 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59200 req_id = b8ffdc2b-ac67-42f8-8a7b-4c784a619223 response_code = 204 uri = /switch-ports
18992024-12-12T04:05:44.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59200 req_id = cf113cc4-d941-434d-afd0-e9ce92b2d5f4 response_code = 200 uri = /network-bootstore-config
19002024-12-12T04:06:06.100ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48001
19012024-12-12T04:06:06.100ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48001 req_id = 9ae0e7cb-49f9-4d9f-babb-521d464bc609 response_code = 200 uri = /baseboard
19022024-12-12T04:06:08.916ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6218 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = b9883e24-2dd9-4851-b174-fc7c73a0c4ae response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
19032024-12-12T04:06:13.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50912
19042024-12-12T04:06:13.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50912 req_id = 2a688194-f619-4359-a8f8-b14ada9d4dea response_code = 200 uri = /vpc-routes
19052024-12-12T04:06:13.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51898
19062024-12-12T04:06:13.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51898 req_id = c10383bb-737d-45b9-8a2a-0096a4d784ab response_code = 200 uri = /v2p
19072024-12-12T04:06:13.149ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
19082024-12-12T04:06:13.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50912 req_id = b4b1e46d-2dfa-499f-b537-7a68812eba33 response_code = 204 uri = /eip-gateways
19092024-12-12T04:06:13.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50912 req_id = 1f68c77c-4b7b-444a-ab37-7ebef26107a5 response_code = 204 uri = /vpc-routes
19102024-12-12T04:06:13.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39965
19112024-12-12T04:06:13.294ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19122024-12-12T04:06:13.331ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19132024-12-12T04:06:13.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39965 req_id = f3822cc9-9e3e-4cbb-8a73-404feef8cb78 response_code = 204 uri = /switch-ports
19142024-12-12T04:06:13.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39965 req_id = 7e1845a5-8165-47d9-95f7-9372dd70aae8 response_code = 200 uri = /network-bootstore-config
19152024-12-12T04:06:13.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37514
19162024-12-12T04:06:13.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37514 req_id = 5e90d015-6ef9-40af-adfd-0704406dadf6 response_code = 200 uri = /vpc-routes
19172024-12-12T04:06:13.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37388
19182024-12-12T04:06:13.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37388 req_id = b0643c13-4633-45fd-a563-f0bf9863c440 response_code = 200 uri = /v2p
19192024-12-12T04:06:14.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
19202024-12-12T04:06:14.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37514 req_id = fb5f4d1c-c0f2-4830-a1bf-d7ecd6392b81 response_code = 204 uri = /eip-gateways
19212024-12-12T04:06:14.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37514 req_id = 11dc4da9-6430-486e-9d63-eb32dd71a0b1 response_code = 204 uri = /vpc-routes
19222024-12-12T04:06:14.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37269
19232024-12-12T04:06:14.164ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19242024-12-12T04:06:14.198ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19252024-12-12T04:06:14.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37269 req_id = 9d720ba8-abb7-4555-b728-8f5a64ef03ca response_code = 204 uri = /switch-ports
19262024-12-12T04:06:14.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37269 req_id = a6f8285d-b907-4848-96a9-1eacb49cd592 response_code = 200 uri = /network-bootstore-config
19272024-12-12T04:06:14.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56398
19282024-12-12T04:06:14.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56398 req_id = 7e03458e-720c-4a15-9190-132f3b27d5a3 response_code = 200 uri = /vpc-routes
19292024-12-12T04:06:14.682ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
19302024-12-12T04:06:14.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56398 req_id = 72b774d1-85ee-4774-b7a1-5c963befbcb8 response_code = 204 uri = /eip-gateways
19312024-12-12T04:06:14.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46480
19322024-12-12T04:06:14.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46480 req_id = 3b9d4b7c-250a-4fdd-865b-db48ac0219d9 response_code = 200 uri = /v2p
19332024-12-12T04:06:14.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56398 req_id = 368ed3f4-b735-421b-bd6f-66e5c34d4fd1 response_code = 204 uri = /vpc-routes
19342024-12-12T04:06:14.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39508
19352024-12-12T04:06:14.988ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19362024-12-12T04:06:15.027ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19372024-12-12T04:06:15.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92761 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39508 req_id = 61bcf512-ef1b-4311-bcfc-728a8592320c response_code = 204 uri = /switch-ports
19382024-12-12T04:06:15.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39508 req_id = fa9527b4-a180-40a4-93f1-209ed5da9999 response_code = 200 uri = /network-bootstore-config
19392024-12-12T04:06:36.135ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50223
19402024-12-12T04:06:36.135ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50223 req_id = 5305f451-3523-4c0c-ae17-d2bde8ed346c response_code = 200 uri = /baseboard
19412024-12-12T04:06:38.917ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6226 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = 90fff156-1a9d-48b6-9fcf-b3b0259fdb01 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
19422024-12-12T04:06:42.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41420
19432024-12-12T04:06:42.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41420 req_id = 4361247d-6ac4-486a-9a36-8218564a0561 response_code = 200 uri = /vpc-routes
19442024-12-12T04:06:42.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40322
19452024-12-12T04:06:42.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40322 req_id = 227051b1-96c1-4c07-b1d4-91ab39e7c1e8 response_code = 200 uri = /v2p
19462024-12-12T04:06:42.980ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
19472024-12-12T04:06:42.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41420 req_id = 079cdfc0-f8d7-4457-bc36-585eec4f7587 response_code = 204 uri = /eip-gateways
19482024-12-12T04:06:42.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41420 req_id = d030e755-61c1-4793-ba73-a847a2e21df2 response_code = 204 uri = /vpc-routes
19492024-12-12T04:06:43.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61091
19502024-12-12T04:06:43.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19512024-12-12T04:06:43.048ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19522024-12-12T04:06:43.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89480 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61091 req_id = da86b00b-d33e-4eee-a8b7-7a6dc5316c28 response_code = 204 uri = /switch-ports
19532024-12-12T04:06:43.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61091 req_id = 45f07447-082b-4e14-8a3c-ada36175da16 response_code = 200 uri = /network-bootstore-config
19542024-12-12T04:06:43.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61075
19552024-12-12T04:06:43.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61075 req_id = 35b0f189-1a70-43a6-9f15-1f43578758fc response_code = 200 uri = /v2p
19562024-12-12T04:06:43.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34459
19572024-12-12T04:06:43.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34459 req_id = b39b8923-023f-4969-83f8-06dd65e07189 response_code = 200 uri = /vpc-routes
19582024-12-12T04:06:43.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
19592024-12-12T04:06:43.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34459 req_id = e1146111-f2a4-41e7-bf4e-d2536ea6e6f7 response_code = 204 uri = /eip-gateways
19602024-12-12T04:06:43.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34459 req_id = 9e7a8c6c-7d13-44ad-8b3c-e1d03d13bfe0 response_code = 204 uri = /vpc-routes
19612024-12-12T04:06:43.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49331
19622024-12-12T04:06:43.999ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19632024-12-12T04:06:44.037ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19642024-12-12T04:06:44.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49331 req_id = 0f26bd1e-a106-4b03-b727-d47b44de1e9c response_code = 204 uri = /switch-ports
19652024-12-12T04:06:44.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49331 req_id = 780d5757-e0b3-4b67-b3e0-10aa38008b14 response_code = 200 uri = /network-bootstore-config
19662024-12-12T04:06:44.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63651
19672024-12-12T04:06:44.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63651 req_id = 45e7bad0-f5b5-4723-bba4-d79992f7c580 response_code = 200 uri = /vpc-routes
19682024-12-12T04:06:44.504ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
19692024-12-12T04:06:44.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63651 req_id = e919d839-a1b3-4ee4-b700-c8523670ee3c response_code = 204 uri = /eip-gateways
19702024-12-12T04:06:44.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53243
19712024-12-12T04:06:44.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53243 req_id = e16b8468-063d-47cc-8475-eabf6dd422ca response_code = 200 uri = /v2p
19722024-12-12T04:06:44.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63651 req_id = 1f897787-beda-47e7-9c03-a496daaf55df response_code = 204 uri = /vpc-routes
19732024-12-12T04:06:44.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45096
19742024-12-12T04:06:44.668ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19752024-12-12T04:06:44.707ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19762024-12-12T04:06:44.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94111 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45096 req_id = 903f2863-081f-4d27-8192-f6e4697c5db4 response_code = 204 uri = /switch-ports
19772024-12-12T04:06:44.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45096 req_id = e78650a5-16eb-4cdf-ac46-9d1b424fd408 response_code = 200 uri = /network-bootstore-config
19782024-12-12T04:07:06.170ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57864
19792024-12-12T04:07:06.170ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57864 req_id = c0701d54-84f8-4787-8c67-a125a996c85f response_code = 200 uri = /baseboard
19802024-12-12T04:07:08.918ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6693 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = bb5c4277-ab1c-4fe5-ab02-65b4d60220ca response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
19812024-12-12T04:07:13.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53781
19822024-12-12T04:07:13.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53781 req_id = 9e034702-95f2-4160-82c3-b92d1b496893 response_code = 200 uri = /vpc-routes
19832024-12-12T04:07:13.163ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
19842024-12-12T04:07:13.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53781 req_id = 34a15566-3d66-445b-b5f4-bc12144cce7e response_code = 204 uri = /eip-gateways
19852024-12-12T04:07:13.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53781 req_id = e9c0e218-fafc-46c6-9656-28dfff533de7 response_code = 204 uri = /vpc-routes
19862024-12-12T04:07:13.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51205
19872024-12-12T04:07:13.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51205 req_id = 8bf3c054-2722-4b6e-a212-7a4d049cc78f response_code = 200 uri = /v2p
19882024-12-12T04:07:13.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48462
19892024-12-12T04:07:13.326ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19902024-12-12T04:07:13.362ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19912024-12-12T04:07:13.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86262 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48462 req_id = 08c012c2-e131-44eb-aad1-5b4f88805af0 response_code = 204 uri = /switch-ports
19922024-12-12T04:07:13.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48462 req_id = 3e3baa0c-a5ff-4f53-8717-5b9aefb48608 response_code = 200 uri = /network-bootstore-config
19932024-12-12T04:07:14.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36860
19942024-12-12T04:07:14.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36860 req_id = c1e3505b-657d-455e-b8bc-35aeb3057133 response_code = 200 uri = /vpc-routes
19952024-12-12T04:07:14.076ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
19962024-12-12T04:07:14.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36860 req_id = 519d271f-41b9-42d9-b733-da818063b5c5 response_code = 204 uri = /eip-gateways
19972024-12-12T04:07:14.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38259
19982024-12-12T04:07:14.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38259 req_id = eea2fda3-235d-4407-921f-ccd4ccc7351c response_code = 200 uri = /v2p
19992024-12-12T04:07:14.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36860 req_id = 3bb3f0de-acc7-4fa5-8094-a1194b7c2115 response_code = 204 uri = /vpc-routes
20002024-12-12T04:07:14.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33374
20012024-12-12T04:07:14.370ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20022024-12-12T04:07:14.418ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20032024-12-12T04:07:14.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127253 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33374 req_id = 76356be9-000c-4b5f-89e9-205551f8fc8d response_code = 204 uri = /switch-ports
20042024-12-12T04:07:14.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33374 req_id = d40a92b6-07fd-4ba0-b38a-7c89fe77e142 response_code = 200 uri = /network-bootstore-config
20052024-12-12T04:07:14.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41813
20062024-12-12T04:07:14.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41813 req_id = 87680318-5f5b-4303-ad1f-eb2c1508dc6d response_code = 200 uri = /vpc-routes
20072024-12-12T04:07:14.707ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
20082024-12-12T04:07:14.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41813 req_id = 14532b1b-6465-4bfe-af52-0e4e71c51c71 response_code = 204 uri = /eip-gateways
20092024-12-12T04:07:14.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48779
20102024-12-12T04:07:14.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48779 req_id = 9206c9bb-f60f-4e73-9280-3c6fe400945a response_code = 200 uri = /v2p
20112024-12-12T04:07:14.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41813 req_id = 7c1e005d-fae4-4de8-b15e-9b3f738a87c5 response_code = 204 uri = /vpc-routes
20122024-12-12T04:07:15.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46042
20132024-12-12T04:07:15.124ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20142024-12-12T04:07:15.163ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20152024-12-12T04:07:15.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92507 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46042 req_id = 62893e05-a8c2-4903-9472-66fadd525f4c response_code = 204 uri = /switch-ports
20162024-12-12T04:07:15.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46042 req_id = f2a45681-d462-4963-9803-aaae2d6e5e0e response_code = 200 uri = /network-bootstore-config
20172024-12-12T04:07:36.204ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33755
20182024-12-12T04:07:36.204ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33755 req_id = 89d2a1eb-50ba-4484-8bdc-63c9228ece7e response_code = 200 uri = /baseboard
20192024-12-12T04:07:38.917ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6346 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = 57d75978-769c-4df0-b6e6-e57da63629b9 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
20202024-12-12T04:07:42.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57796
20212024-12-12T04:07:42.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57796 req_id = 24f001cf-784f-4178-9f1b-70cd6d691eb1 response_code = 200 uri = /vpc-routes
20222024-12-12T04:07:42.934ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
20232024-12-12T04:07:42.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57796 req_id = 44242486-d560-494e-8989-d04b9509188d response_code = 204 uri = /eip-gateways
20242024-12-12T04:07:42.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57796 req_id = 43eee4b2-ac6c-4542-bf43-8eeb73f9ee3c response_code = 204 uri = /vpc-routes
20252024-12-12T04:07:42.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39129
20262024-12-12T04:07:42.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39129 req_id = d50ffbb0-1c2d-4bad-ae7a-f9e7c4b6a9e6 response_code = 200 uri = /v2p
20272024-12-12T04:07:42.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46454
20282024-12-12T04:07:42.985ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20292024-12-12T04:07:43.023ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20302024-12-12T04:07:43.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92741 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46454 req_id = 266b5454-b481-41fd-af3b-81d4e611ce0a response_code = 204 uri = /switch-ports
20312024-12-12T04:07:43.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46454 req_id = 7b8ea0ed-4789-40a6-9367-0f9d89068718 response_code = 200 uri = /network-bootstore-config
20322024-12-12T04:07:43.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34495
20332024-12-12T04:07:43.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34495 req_id = 3b52aecd-5f97-47a5-9b0d-755e6c92ac6f response_code = 200 uri = /v2p
20342024-12-12T04:07:43.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55477
20352024-12-12T04:07:43.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55477 req_id = b7c16908-54c3-46e7-b6df-3d86d1842783 response_code = 200 uri = /vpc-routes
20362024-12-12T04:07:44.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42147
20372024-12-12T04:07:44.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20382024-12-12T04:07:44.096ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20392024-12-12T04:07:44.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91486 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42147 req_id = 516f6c2f-f047-4a05-98e6-8bcebc3b85b6 response_code = 204 uri = /switch-ports
20402024-12-12T04:07:44.151ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
20412024-12-12T04:07:44.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55477 req_id = ea81c9ee-6774-4a69-94c4-ffe41ebb3851 response_code = 204 uri = /eip-gateways
20422024-12-12T04:07:44.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42147 req_id = 4834512a-bf1f-4e0b-975e-88db2384e134 response_code = 200 uri = /network-bootstore-config
20432024-12-12T04:07:44.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55477 req_id = d797e8e7-576d-4257-9386-440e40bf9f99 response_code = 204 uri = /vpc-routes
20442024-12-12T04:07:44.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46547
20452024-12-12T04:07:44.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46547 req_id = 6e1900ee-8e67-44bb-897a-0173d32e5443 response_code = 200 uri = /vpc-routes
20462024-12-12T04:07:44.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54110
20472024-12-12T04:07:44.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54110 req_id = a6af3ce3-ed3e-445d-af32-0a7bc2e8e38f response_code = 200 uri = /v2p
20482024-12-12T04:07:44.665ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
20492024-12-12T04:07:44.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46547 req_id = 998fa39b-acae-4a30-8d2f-311145e29a6c response_code = 204 uri = /eip-gateways
20502024-12-12T04:07:44.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46547 req_id = 90154f43-0131-4386-84bb-198012a5405f response_code = 204 uri = /vpc-routes
20512024-12-12T04:07:44.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60502
20522024-12-12T04:07:44.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20532024-12-12T04:07:44.756ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20542024-12-12T04:07:44.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88370 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60502 req_id = 877dd87e-ea22-449b-a46c-a7423b58c388 response_code = 204 uri = /switch-ports
20552024-12-12T04:07:44.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60502 req_id = ee7629ad-873a-4825-a09f-f67ed7ffeaf1 response_code = 200 uri = /network-bootstore-config
20562024-12-12T04:08:06.237ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62382
20572024-12-12T04:08:06.237ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62382 req_id = 8d757332-2e34-4379-9edd-e71356c8d6e7 response_code = 200 uri = /baseboard
20582024-12-12T04:08:08.917ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6045 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = df564819-345b-4336-a0b7-5844e364e56b response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
20592024-12-12T04:08:13.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38910
20602024-12-12T04:08:13.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38910 req_id = 13fd4d7c-7ca1-44f5-9cfb-95e0220b46d3 response_code = 200 uri = /vpc-routes
20612024-12-12T04:08:13.073ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
20622024-12-12T04:08:13.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38910 req_id = a1780248-c2e4-4d26-bd6e-bd22b39f2a1c response_code = 204 uri = /eip-gateways
20632024-12-12T04:08:13.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38910 req_id = 80467edb-f4db-4590-8958-5df8352bfd88 response_code = 204 uri = /vpc-routes
20642024-12-12T04:08:13.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50310
20652024-12-12T04:08:13.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50310 req_id = 06dd6709-30f4-4889-beb3-9679b74c3e6c response_code = 200 uri = /v2p
20662024-12-12T04:08:13.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51783
20672024-12-12T04:08:13.289ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20682024-12-12T04:08:13.325ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20692024-12-12T04:08:13.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93567 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51783 req_id = 42ba0d70-e7f3-4f13-960d-ef66db938a74 response_code = 204 uri = /switch-ports
20702024-12-12T04:08:13.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51783 req_id = 25c58134-e6de-443e-b204-acf9f302bf97 response_code = 200 uri = /network-bootstore-config
20712024-12-12T04:08:14.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47258
20722024-12-12T04:08:14.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47258 req_id = 460e2aa1-ae8e-4a7a-adaa-5c64010236d1 response_code = 200 uri = /vpc-routes
20732024-12-12T04:08:14.074ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
20742024-12-12T04:08:14.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47258 req_id = 001b8b33-34e3-4aa8-a3a5-01ce17ae036b response_code = 204 uri = /eip-gateways
20752024-12-12T04:08:14.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47258 req_id = a25995f6-da30-45b7-8f40-ab877cf31ecc response_code = 204 uri = /vpc-routes
20762024-12-12T04:08:14.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58713
20772024-12-12T04:08:14.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58713 req_id = b8318afc-beb1-4150-9a3e-7d68a2980ca7 response_code = 200 uri = /v2p
20782024-12-12T04:08:14.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56015
20792024-12-12T04:08:14.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56015 req_id = 75488338-6120-4194-b579-cf4ab6e4c3a0 response_code = 200 uri = /vpc-routes
20802024-12-12T04:08:14.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55968
20812024-12-12T04:08:14.573ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20822024-12-12T04:08:14.620ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20832024-12-12T04:08:14.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104320 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55968 req_id = c8961f10-8a52-499d-94b5-95b284ddb702 response_code = 204 uri = /switch-ports
20842024-12-12T04:08:14.678ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
20852024-12-12T04:08:14.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56015 req_id = b7990087-a8c7-47a2-a3db-b5310c6f0bf2 response_code = 204 uri = /eip-gateways
20862024-12-12T04:08:14.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55968 req_id = 87ebf654-3f07-426c-8edc-257ffba0a608 response_code = 200 uri = /network-bootstore-config
20872024-12-12T04:08:14.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51123
20882024-12-12T04:08:14.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51123 req_id = 39bdfd71-1ada-4652-95dc-74f5b78f880e response_code = 200 uri = /v2p
20892024-12-12T04:08:14.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56015 req_id = e7bbb065-380b-4c9e-9afe-aa1ac7144352 response_code = 204 uri = /vpc-routes
20902024-12-12T04:08:14.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65006
20912024-12-12T04:08:14.927ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20922024-12-12T04:08:14.964ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20932024-12-12T04:08:15.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85213 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65006 req_id = 3ad08124-87a9-4e50-bde5-fd97af34a1fc response_code = 204 uri = /switch-ports
20942024-12-12T04:08:15.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65006 req_id = f65b692f-7b01-4a78-9346-00a7e499a343 response_code = 200 uri = /network-bootstore-config
20952024-12-12T04:08:36.270ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42260
20962024-12-12T04:08:36.270ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42260 req_id = 80e61ab8-10b6-4325-94ad-52a3427d26a8 response_code = 200 uri = /baseboard
20972024-12-12T04:08:38.918ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7214 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = f4a3340c-be2b-4956-ae55-6c5113f16b40 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
20982024-12-12T04:08:42.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62922
20992024-12-12T04:08:42.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62922 req_id = dc4ba1b1-2ca5-407f-a1c7-99bbd4dd9070 response_code = 200 uri = /vpc-routes
21002024-12-12T04:08:42.920ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
21012024-12-12T04:08:42.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62922 req_id = 963c89b8-bb85-4aae-a4b5-69818385bd13 response_code = 204 uri = /eip-gateways
21022024-12-12T04:08:42.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62922 req_id = c24c30d1-0119-43b0-a71c-62acb8886cc6 response_code = 204 uri = /vpc-routes
21032024-12-12T04:08:42.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61932
21042024-12-12T04:08:42.965ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21052024-12-12T04:08:43.003ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21062024-12-12T04:08:43.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90727 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61932 req_id = 7729712e-ed64-49d9-b8b7-c1e0f8308cd5 response_code = 204 uri = /switch-ports
21072024-12-12T04:08:43.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49329
21082024-12-12T04:08:43.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61932 req_id = 15351f51-6f62-4dd1-8059-f7242dc697da response_code = 200 uri = /network-bootstore-config
21092024-12-12T04:08:43.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49329 req_id = a8a5619b-bef5-4338-93db-cca81f6482ff response_code = 200 uri = /v2p
21102024-12-12T04:08:43.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37817
21112024-12-12T04:08:43.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37817 req_id = 187d33e1-db67-4c1c-b09e-9dfc811b48d6 response_code = 200 uri = /vpc-routes
21122024-12-12T04:08:43.933ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
21132024-12-12T04:08:43.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37817 req_id = 57b5ef90-3eeb-48f6-a3de-409a292026f6 response_code = 204 uri = /eip-gateways
21142024-12-12T04:08:43.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43158
21152024-12-12T04:08:43.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43158 req_id = 05ffaf33-c878-4f26-b122-93bfbea40c00 response_code = 200 uri = /v2p
21162024-12-12T04:08:43.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37817 req_id = cc37d491-8b6a-4383-a980-b9cf0a22a00e response_code = 204 uri = /vpc-routes
21172024-12-12T04:08:44.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40994
21182024-12-12T04:08:44.022ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21192024-12-12T04:08:44.061ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21202024-12-12T04:08:44.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91402 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40994 req_id = 23c48bc8-da99-4fac-8147-dddf2f4efbc5 response_code = 204 uri = /switch-ports
21212024-12-12T04:08:44.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40994 req_id = 118f80ce-ef4c-4d5f-a9ee-f72531d45341 response_code = 200 uri = /network-bootstore-config
21222024-12-12T04:08:44.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43095
21232024-12-12T04:08:44.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43095 req_id = 03974596-428a-44e9-a9df-f244d7ac8438 response_code = 200 uri = /vpc-routes
21242024-12-12T04:08:44.549ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
21252024-12-12T04:08:44.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43095 req_id = daae17b0-ad29-49a0-b2f5-039bdc6b36d8 response_code = 204 uri = /eip-gateways
21262024-12-12T04:08:44.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43095 req_id = 53e5081c-70f6-41bb-aa48-dc19a855d089 response_code = 204 uri = /vpc-routes
21272024-12-12T04:08:44.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50722
21282024-12-12T04:08:44.617ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21292024-12-12T04:08:44.657ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21302024-12-12T04:08:44.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50722 req_id = c680da78-9945-4813-a1a0-2d84cc4d6ce2 response_code = 204 uri = /switch-ports
21312024-12-12T04:08:44.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41887
21322024-12-12T04:08:44.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50722 req_id = 5fa13c0b-f31b-4022-a751-7cd7bfb5955d response_code = 200 uri = /network-bootstore-config
21332024-12-12T04:08:44.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41887 req_id = 13cbd02f-ad2f-4587-90de-bf6ee4ef4d4a response_code = 200 uri = /v2p
21342024-12-12T04:09:06.304ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37315
21352024-12-12T04:09:06.304ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37315 req_id = f28b5357-8531-410b-88ee-1bfdc7c8178a response_code = 200 uri = /baseboard
21362024-12-12T04:09:08.917ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6131 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = f0ac75ae-3976-41f8-9603-9805c2c9e984 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
21372024-12-12T04:09:13.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36873
21382024-12-12T04:09:13.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36873 req_id = e6b4fcd4-215f-44ca-b26a-b65c45d3542b response_code = 200 uri = /vpc-routes
21392024-12-12T04:09:13.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
21402024-12-12T04:09:13.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36873 req_id = 830dc36f-a395-4ea6-83a5-0e0ee8d8cbdf response_code = 204 uri = /eip-gateways
21412024-12-12T04:09:13.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36873 req_id = c0feaac9-ee19-470d-ac98-a076dab63b52 response_code = 204 uri = /vpc-routes
21422024-12-12T04:09:13.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39637
21432024-12-12T04:09:13.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39637 req_id = 98ff7342-426a-45e6-a6fb-765b87dd84b4 response_code = 200 uri = /v2p
21442024-12-12T04:09:13.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64864
21452024-12-12T04:09:13.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21462024-12-12T04:09:13.396ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21472024-12-12T04:09:13.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82668 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64864 req_id = 47268054-2e9a-426c-91ea-b8444e8cd20a response_code = 204 uri = /switch-ports
21482024-12-12T04:09:13.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64864 req_id = 105defff-f45f-4995-ad51-a87c88460cf9 response_code = 200 uri = /network-bootstore-config
21492024-12-12T04:09:13.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62781
21502024-12-12T04:09:13.453ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21512024-12-12T04:09:13.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21522024-12-12T04:09:13.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21532024-12-12T04:09:13.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21542024-12-12T04:09:13.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21552024-12-12T04:09:13.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21562024-12-12T04:09:13.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21572024-12-12T04:09:13.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62781 req_id = 5b00154e-0740-4d18-91ba-68c4511aa8ed response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21582024-12-12T04:09:14.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58119
21592024-12-12T04:09:14.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58119 req_id = 0c6bcd22-6076-4c4d-8880-5bdbd6181ad3 response_code = 200 uri = /vpc-routes
21602024-12-12T04:09:14.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
21612024-12-12T04:09:14.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58119 req_id = a0817cf7-abc5-4321-a72e-735c04c4a0ec response_code = 204 uri = /eip-gateways
21622024-12-12T04:09:14.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56298
21632024-12-12T04:09:14.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56298 req_id = 4a66e876-ecac-4823-898c-938289f4ac8c response_code = 200 uri = /v2p
21642024-12-12T04:09:14.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58119 req_id = 738d9a45-78e9-46b2-866e-2e6265ce7eae response_code = 204 uri = /vpc-routes
21652024-12-12T04:09:14.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57553
21662024-12-12T04:09:14.141ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21672024-12-12T04:09:14.180ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21682024-12-12T04:09:14.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97919 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57553 req_id = 128cbac4-78b1-47b8-929c-04aeb7a26284 response_code = 204 uri = /switch-ports
21692024-12-12T04:09:14.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57553 req_id = a3c414b1-02c2-4994-bfa1-4c9d3abbedcb response_code = 200 uri = /network-bootstore-config
21702024-12-12T04:09:14.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51905
21712024-12-12T04:09:14.282ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21722024-12-12T04:09:14.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21732024-12-12T04:09:14.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21742024-12-12T04:09:14.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21752024-12-12T04:09:14.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21762024-12-12T04:09:14.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21772024-12-12T04:09:14.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21782024-12-12T04:09:14.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 440 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51905 req_id = b4a2902a-ae12-4a9a-9895-7a8a4347614f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21792024-12-12T04:09:14.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46166
21802024-12-12T04:09:14.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46166 req_id = 2eda01f8-c4cf-44aa-bd85-7f721790cde0 response_code = 200 uri = /vpc-routes
21812024-12-12T04:09:14.636ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
21822024-12-12T04:09:14.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46166 req_id = 2c48201a-e967-4584-8a6d-7d7f8199acec response_code = 204 uri = /eip-gateways
21832024-12-12T04:09:14.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46166 req_id = 452e2589-10b7-4eb7-b8f1-deba5a9d72e3 response_code = 204 uri = /vpc-routes
21842024-12-12T04:09:14.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48168
21852024-12-12T04:09:14.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48168 req_id = 7ca67cbd-cea3-4711-ae9a-1dcfaa2c895b response_code = 200 uri = /v2p
21862024-12-12T04:09:14.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59548
21872024-12-12T04:09:14.913ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21882024-12-12T04:09:14.955ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21892024-12-12T04:09:15.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59548 req_id = 3cf8c3ff-47e5-4d27-b09b-eba108085ab0 response_code = 204 uri = /switch-ports
21902024-12-12T04:09:15.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57612
21912024-12-12T04:09:15.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59548 req_id = a25a2a90-b936-4d32-a380-9a695a13aa97 response_code = 200 uri = /network-bootstore-config
21922024-12-12T04:09:15.009ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21932024-12-12T04:09:15.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21942024-12-12T04:09:15.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21952024-12-12T04:09:15.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21962024-12-12T04:09:15.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21972024-12-12T04:09:15.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21982024-12-12T04:09:15.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21992024-12-12T04:09:15.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57612 req_id = 8c40f903-6c89-4f1f-892d-dddf54a2c316 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22002024-12-12T04:09:36.335ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38777
22012024-12-12T04:09:36.336ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38777 req_id = 4ceb3b9e-3516-4e2e-9c92-47d432ee11fb response_code = 200 uri = /baseboard
22022024-12-12T04:09:38.918ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6932 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = cb361095-9532-478f-a5ef-404a44c3a131 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
22032024-12-12T04:09:41.431ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22042024-12-12T04:09:41.431ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22052024-12-12T04:09:41.460ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 4614, tv_nsec: 265714905 } time_to_next_cleanup = 599.999996349s
22062024-12-12T04:09:42.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56477
22072024-12-12T04:09:42.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56477 req_id = b34a1d9d-4600-4b0c-a7df-36b7dc167993 response_code = 200 uri = /vpc-routes
22082024-12-12T04:09:42.957ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
22092024-12-12T04:09:42.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56477 req_id = da1e7f0f-f0a0-499e-b442-a06361a42558 response_code = 204 uri = /eip-gateways
22102024-12-12T04:09:42.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56477 req_id = 3b6807c9-239d-4c2b-ab57-644a522ec296 response_code = 204 uri = /vpc-routes
22112024-12-12T04:09:42.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41208
22122024-12-12T04:09:42.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41208 req_id = 61bb77d6-ec64-4d74-bd10-58db2931e614 response_code = 200 uri = /v2p
22132024-12-12T04:09:43.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56319
22142024-12-12T04:09:43.005ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22152024-12-12T04:09:43.041ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22162024-12-12T04:09:43.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89854 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56319 req_id = 442584ab-26f4-414b-ada4-a00a7a649a81 response_code = 204 uri = /switch-ports
22172024-12-12T04:09:43.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56319 req_id = 8c32ea06-6093-4ed5-8e3a-c3e1d5aa3f14 response_code = 200 uri = /network-bootstore-config
22182024-12-12T04:09:43.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58019
22192024-12-12T04:09:43.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58019 req_id = 05914117-4e9b-4d10-a52b-95f21162fb83 response_code = 200 uri = /vpc-routes
22202024-12-12T04:09:43.828ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
22212024-12-12T04:09:43.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58019 req_id = 00d36fef-efd2-432f-ac33-9dd271afa13e response_code = 204 uri = /eip-gateways
22222024-12-12T04:09:43.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58019 req_id = 9685bbad-6651-402c-bc46-9445e44deb2d response_code = 204 uri = /vpc-routes
22232024-12-12T04:09:44.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35321
22242024-12-12T04:09:44.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35321 req_id = 67359b72-d875-4607-b9ab-246f7591277f response_code = 200 uri = /v2p
22252024-12-12T04:09:44.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38963
22262024-12-12T04:09:44.019ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22272024-12-12T04:09:44.055ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22282024-12-12T04:09:44.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90305 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38963 req_id = 3120373f-4f92-4d35-97f9-620b3d905955 response_code = 204 uri = /switch-ports
22292024-12-12T04:09:44.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38963 req_id = ed69513c-5849-4752-a50c-e009cc114c3b response_code = 200 uri = /network-bootstore-config
22302024-12-12T04:09:44.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55855
22312024-12-12T04:09:44.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55855 req_id = 3b8790bc-3e84-44c3-a233-b0adb75762e2 response_code = 200 uri = /vpc-routes
22322024-12-12T04:09:44.606ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
22332024-12-12T04:09:44.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55855 req_id = 2aa556d2-e0bf-4ab3-948c-04b5c87b7a07 response_code = 204 uri = /eip-gateways
22342024-12-12T04:09:44.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55855 req_id = a3deac06-e826-4d09-868c-e85741ef8ebf response_code = 204 uri = /vpc-routes
22352024-12-12T04:09:44.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53346
22362024-12-12T04:09:44.635ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22372024-12-12T04:09:44.672ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22382024-12-12T04:09:44.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53346 req_id = 53e7f40a-27df-4b21-895f-f6cc94a1d774 response_code = 204 uri = /switch-ports
22392024-12-12T04:09:44.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50353
22402024-12-12T04:09:44.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50353 req_id = ecdfd7c6-0d17-4897-a205-0cd10511f28c response_code = 200 uri = /v2p
22412024-12-12T04:09:44.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53346 req_id = 3b84bd44-d093-4496-941a-c26ec12ddba8 response_code = 200 uri = /network-bootstore-config
22422024-12-12T04:09:55.873ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22432024-12-12T04:10:06.369ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48666
22442024-12-12T04:10:06.369ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48666 req_id = 6b2d3231-1893-4385-829f-9a72d5ae0e82 response_code = 200 uri = /baseboard
22452024-12-12T04:10:08.918ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7924 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = 20282dd4-0b4f-401d-8cc7-653d1fa4cea8 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
22462024-12-12T04:10:13.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44799
22472024-12-12T04:10:13.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44799 req_id = c09f036e-5849-4394-8713-6b010cd0fb74 response_code = 200 uri = /vpc-routes
22482024-12-12T04:10:13.067ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
22492024-12-12T04:10:13.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44799 req_id = 05036fa0-d189-49fe-aea6-d3ae1ed78521 response_code = 204 uri = /eip-gateways
22502024-12-12T04:10:13.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44799 req_id = 97983fdd-6c6f-4002-9bb9-6ff43009c756 response_code = 204 uri = /vpc-routes
22512024-12-12T04:10:13.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50105
22522024-12-12T04:10:13.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50105 req_id = a9b8b401-de40-4a1b-a3b7-52020e105cac response_code = 200 uri = /v2p
22532024-12-12T04:10:13.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53364
22542024-12-12T04:10:13.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22552024-12-12T04:10:13.203ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22562024-12-12T04:10:13.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86268 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53364 req_id = 29cf6586-a07a-4bc6-858d-1a31d6a9a846 response_code = 204 uri = /switch-ports
22572024-12-12T04:10:13.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53364 req_id = d24a0d9d-e6a1-4d01-88fd-420b0cfbdcac response_code = 200 uri = /network-bootstore-config
22582024-12-12T04:10:14.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50995
22592024-12-12T04:10:14.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50995 req_id = 03af205c-a0e9-4bad-a12b-5773ec698fe7 response_code = 200 uri = /vpc-routes
22602024-12-12T04:10:14.201ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
22612024-12-12T04:10:14.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50995 req_id = aa09908e-f4bb-426c-9dac-d24592415ddb response_code = 204 uri = /eip-gateways
22622024-12-12T04:10:14.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50995 req_id = e350e423-e1ce-4186-872e-b504285870c8 response_code = 204 uri = /vpc-routes
22632024-12-12T04:10:14.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45656
22642024-12-12T04:10:14.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22652024-12-12T04:10:14.330ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22662024-12-12T04:10:14.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126535 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45656 req_id = d33df8e9-da48-4308-854f-fc5ba63d534f response_code = 204 uri = /switch-ports
22672024-12-12T04:10:14.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62930
22682024-12-12T04:10:14.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62930 req_id = e296b9a3-6d26-446d-8200-803f2c90b3fa response_code = 200 uri = /v2p
22692024-12-12T04:10:14.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45656 req_id = 05702eec-7b0a-4f1e-86a6-e4e158466e74 response_code = 200 uri = /network-bootstore-config
22702024-12-12T04:10:14.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52760
22712024-12-12T04:10:14.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52760 req_id = e273aa1a-1bcb-4d93-9ae1-a47e67557fc6 response_code = 200 uri = /vpc-routes
22722024-12-12T04:10:14.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
22732024-12-12T04:10:14.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52760 req_id = da6bd28a-151d-4efb-bc7f-c1e0f83b7d43 response_code = 204 uri = /eip-gateways
22742024-12-12T04:10:14.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52760 req_id = 482b1cee-fccc-4fdb-b3d0-e4d7b66f2e91 response_code = 204 uri = /vpc-routes
22752024-12-12T04:10:14.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56023
22762024-12-12T04:10:14.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56023 req_id = 6d80f79c-d862-4079-9b50-ea7afa4205a0 response_code = 200 uri = /v2p
22772024-12-12T04:10:14.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34100
22782024-12-12T04:10:14.772ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22792024-12-12T04:10:14.808ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22802024-12-12T04:10:14.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88025 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34100 req_id = dda11a22-ee7e-4da8-84de-b76010c81ef9 response_code = 204 uri = /switch-ports
22812024-12-12T04:10:14.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34100 req_id = 531c24b8-b4fb-4724-838c-701dd76ac73a response_code = 200 uri = /network-bootstore-config
22822024-12-12T04:10:36.401ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57085
22832024-12-12T04:10:36.402ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57085 req_id = 4b8e9271-5295-4385-a0c1-4f4525755106 response_code = 200 uri = /baseboard
22842024-12-12T04:10:38.917ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6602 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = 71af6e24-8e89-44df-9506-d228bcc754ff response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
22852024-12-12T04:10:42.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43236
22862024-12-12T04:10:42.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43236 req_id = 1762bda5-47b0-47a0-b467-0a13285cdd53 response_code = 200 uri = /vpc-routes
22872024-12-12T04:10:42.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
22882024-12-12T04:10:42.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43236 req_id = 67cca87e-3562-40cd-a524-f02a1c1e7600 response_code = 204 uri = /eip-gateways
22892024-12-12T04:10:43.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32965
22902024-12-12T04:10:43.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32965 req_id = 3017b372-1861-4d0b-9a74-6c06b07f09f6 response_code = 200 uri = /v2p
22912024-12-12T04:10:43.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43236 req_id = 7c8b26b4-7fc8-448b-a155-00dcbcb2e72d response_code = 204 uri = /vpc-routes
22922024-12-12T04:10:43.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55662
22932024-12-12T04:10:43.121ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22942024-12-12T04:10:43.159ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22952024-12-12T04:10:43.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55662 req_id = c329f873-2d2e-4bc5-bbfe-2a2e062c8e75 response_code = 204 uri = /switch-ports
22962024-12-12T04:10:43.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55662 req_id = 779997e4-16b4-4353-9e1d-5795453205c8 response_code = 200 uri = /network-bootstore-config
22972024-12-12T04:10:43.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63970
22982024-12-12T04:10:43.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63970 req_id = dff0208e-c3d0-4185-9eab-fea5a3533ca3 response_code = 200 uri = /vpc-routes
22992024-12-12T04:10:43.829ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
23002024-12-12T04:10:43.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63970 req_id = 2d67ff7e-8c4a-469a-8b0e-f5ba3127fe7d response_code = 204 uri = /eip-gateways
23012024-12-12T04:10:43.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63970 req_id = 8db554da-2f5a-4900-b2a1-c8f19cbfb639 response_code = 204 uri = /vpc-routes
23022024-12-12T04:10:43.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44931
23032024-12-12T04:10:43.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44931 req_id = dec7678f-84d8-4351-83e9-815663161aa4 response_code = 200 uri = /v2p
23042024-12-12T04:10:44.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64835
23052024-12-12T04:10:44.007ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23062024-12-12T04:10:44.043ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23072024-12-12T04:10:44.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88885 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64835 req_id = 759768c1-a27a-4490-94d5-0b35f4fee649 response_code = 204 uri = /switch-ports
23082024-12-12T04:10:44.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64835 req_id = 570cc80b-b90c-4b79-a6e6-497203f7d369 response_code = 200 uri = /network-bootstore-config
23092024-12-12T04:10:44.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65388
23102024-12-12T04:10:44.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65388 req_id = d68af39a-47b3-416f-86e9-dfe384ffc691 response_code = 200 uri = /vpc-routes
23112024-12-12T04:10:44.592ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
23122024-12-12T04:10:44.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65388 req_id = 8ae750da-f684-452f-bc86-0636a07272da response_code = 204 uri = /eip-gateways
23132024-12-12T04:10:44.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65388 req_id = b44f4988-a6e1-4c09-a0ef-bbd29e82f6e6 response_code = 204 uri = /vpc-routes
23142024-12-12T04:10:44.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42128
23152024-12-12T04:10:44.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42128 req_id = f72205f6-4128-45e2-98ed-d31fb408f3a6 response_code = 200 uri = /v2p
23162024-12-12T04:10:44.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42195
23172024-12-12T04:10:44.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23182024-12-12T04:10:44.733ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23192024-12-12T04:10:44.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88462 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42195 req_id = b0abda8f-07b9-4d5f-82fa-083c5ba40321 response_code = 204 uri = /switch-ports
23202024-12-12T04:10:44.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42195 req_id = aa40fd50-b43e-4acd-832f-102852364ccc response_code = 200 uri = /network-bootstore-config
23212024-12-12T04:11:06.435ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62257
23222024-12-12T04:11:06.436ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62257 req_id = 41c4f0ef-cd9a-4de2-aef8-9028bf481d78 response_code = 200 uri = /baseboard
23232024-12-12T04:11:08.917ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6472 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = 263b67b6-6225-49c9-b06e-af65c1b7071a response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
23242024-12-12T04:11:13.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59946
23252024-12-12T04:11:13.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59946 req_id = 01946167-a86f-474e-a7c0-5f6e847bc1d2 response_code = 200 uri = /vpc-routes
23262024-12-12T04:11:13.161ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
23272024-12-12T04:11:13.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59946 req_id = 5e11b7e7-003a-44a1-8afd-e5afd0ce0354 response_code = 204 uri = /eip-gateways
23282024-12-12T04:11:13.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55723
23292024-12-12T04:11:13.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55723 req_id = e83cb8d3-74ea-4df9-9b0c-47582f397888 response_code = 200 uri = /v2p
23302024-12-12T04:11:13.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59946 req_id = 151b4d79-3843-40dc-91fb-7701205bf4e0 response_code = 204 uri = /vpc-routes
23312024-12-12T04:11:13.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51683
23322024-12-12T04:11:13.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23332024-12-12T04:11:13.248ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23342024-12-12T04:11:13.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90056 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51683 req_id = 7532585d-6873-44b2-9df8-7eb00667b01b response_code = 204 uri = /switch-ports
23352024-12-12T04:11:13.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51683 req_id = 82512dff-8595-463d-98f9-63c7a355a26d response_code = 200 uri = /network-bootstore-config
23362024-12-12T04:11:14.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42450
23372024-12-12T04:11:14.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42450 req_id = c1461258-abd6-42d0-8d7e-c01b19817fbc response_code = 200 uri = /v2p
23382024-12-12T04:11:14.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35112
23392024-12-12T04:11:14.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35112 req_id = 11a9c470-b362-4e93-81b9-4c38be56cafb response_code = 200 uri = /vpc-routes
23402024-12-12T04:11:14.154ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
23412024-12-12T04:11:14.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35112 req_id = e0f95eca-60ad-42fb-b704-bff284f6c8ff response_code = 204 uri = /eip-gateways
23422024-12-12T04:11:14.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35112 req_id = 536bdd35-7d3d-4c7b-b33f-9d98448ae856 response_code = 204 uri = /vpc-routes
23432024-12-12T04:11:14.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63963
23442024-12-12T04:11:14.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23452024-12-12T04:11:14.202ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23462024-12-12T04:11:14.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87761 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63963 req_id = 6b6c8861-50d4-4189-b3cb-fb3471e9a97a response_code = 204 uri = /switch-ports
23472024-12-12T04:11:14.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63963 req_id = d6fba2d9-3c60-4de9-9289-97693db950bc response_code = 200 uri = /network-bootstore-config
23482024-12-12T04:11:14.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38808
23492024-12-12T04:11:14.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38808 req_id = bd3cac6c-e8b1-41f4-a405-90013754d58e response_code = 200 uri = /vpc-routes
23502024-12-12T04:11:14.708ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
23512024-12-12T04:11:14.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38808 req_id = 83a42171-c082-4175-8b48-ae4919d99d6d response_code = 204 uri = /eip-gateways
23522024-12-12T04:11:14.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38808 req_id = 60e4bc82-aea9-4c30-aeb0-ab4d38a02f86 response_code = 204 uri = /vpc-routes
23532024-12-12T04:11:14.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54844
23542024-12-12T04:11:14.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54844 req_id = 35a30231-4af6-462f-8783-9ec8f1c23083 response_code = 200 uri = /v2p
23552024-12-12T04:11:14.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36655
23562024-12-12T04:11:14.912ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23572024-12-12T04:11:14.952ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23582024-12-12T04:11:15.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36655 req_id = a99450e3-983e-44a5-bc12-99f7aff973d2 response_code = 204 uri = /switch-ports
23592024-12-12T04:11:15.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36655 req_id = be95af76-d55d-47a8-8d6a-66e0918f1cb7 response_code = 200 uri = /network-bootstore-config
23602024-12-12T04:11:36.469ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52739
23612024-12-12T04:11:36.470ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52739 req_id = 0b930ca4-1c56-4cdf-b864-bfcd3d375ed3 response_code = 200 uri = /baseboard
23622024-12-12T04:11:38.917ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6539 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = 4b7c161d-b04f-45b4-9443-a11a3a89dbab response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
23632024-12-12T04:11:42.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44318
23642024-12-12T04:11:42.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44318 req_id = 972a34cd-448e-42e0-9e1a-df749255c7b9 response_code = 200 uri = /v2p
23652024-12-12T04:11:43.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35659
23662024-12-12T04:11:43.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35659 req_id = 22526eaa-05ad-4c76-aa9a-2a7d18af12d0 response_code = 200 uri = /vpc-routes
23672024-12-12T04:11:43.082ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
23682024-12-12T04:11:43.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35659 req_id = 88c15493-fe5c-4175-ad2a-3661c3b67e2d response_code = 204 uri = /eip-gateways
23692024-12-12T04:11:43.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35659 req_id = fdf1e9d0-b564-4e77-b4da-eace691fe2be response_code = 204 uri = /vpc-routes
23702024-12-12T04:11:43.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35431
23712024-12-12T04:11:43.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23722024-12-12T04:11:43.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23732024-12-12T04:11:43.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95456 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35431 req_id = d2e4475b-de90-44b6-be3a-462d060317fc response_code = 204 uri = /switch-ports
23742024-12-12T04:11:43.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35431 req_id = bb1369c8-c902-4c17-a435-401d6f87c60c response_code = 200 uri = /network-bootstore-config
23752024-12-12T04:11:43.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59012
23762024-12-12T04:11:43.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59012 req_id = d18fbda0-baf4-4e78-9e91-edc9165e7b94 response_code = 200 uri = /vpc-routes
23772024-12-12T04:11:43.872ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
23782024-12-12T04:11:43.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59012 req_id = 9772d992-58ae-489b-bf3e-f82165038283 response_code = 204 uri = /eip-gateways
23792024-12-12T04:11:43.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59012 req_id = 4ed906e5-854d-4b1c-8a60-d2876601ef23 response_code = 204 uri = /vpc-routes
23802024-12-12T04:11:43.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64115
23812024-12-12T04:11:43.931ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23822024-12-12T04:11:43.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23832024-12-12T04:11:44.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97635 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64115 req_id = 7b8f56e2-8b74-478c-ba78-c69f4068c697 response_code = 204 uri = /switch-ports
23842024-12-12T04:11:44.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62589
23852024-12-12T04:11:44.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62589 req_id = 6207036e-285f-49cb-bacb-7b64d83ea78b response_code = 200 uri = /v2p
23862024-12-12T04:11:44.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64115 req_id = e2a83271-39a9-4e30-9cc8-c384e03eb809 response_code = 200 uri = /network-bootstore-config
23872024-12-12T04:11:44.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40320
23882024-12-12T04:11:44.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40320 req_id = bb46a6cd-4a75-4e56-9556-6ba512796460 response_code = 200 uri = /vpc-routes
23892024-12-12T04:11:44.585ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
23902024-12-12T04:11:44.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40320 req_id = 2a31956f-39ae-4742-8f89-8f5b3bd18234 response_code = 204 uri = /eip-gateways
23912024-12-12T04:11:44.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40320 req_id = 5f4311c8-158e-43dc-9eba-29fa523f14bd response_code = 204 uri = /vpc-routes
23922024-12-12T04:11:44.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38106
23932024-12-12T04:11:44.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38106 req_id = 9ba2cc5a-bf76-4a56-9c41-541781c20c2d response_code = 200 uri = /v2p
23942024-12-12T04:11:44.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40082
23952024-12-12T04:11:44.853ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23962024-12-12T04:11:44.889ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23972024-12-12T04:11:44.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40082 req_id = adf7e104-1ca3-4fac-9df2-bae0572580e6 response_code = 204 uri = /switch-ports
23982024-12-12T04:11:44.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40082 req_id = 58673cf9-93ca-45be-8b13-578d3d84b2c0 response_code = 200 uri = /network-bootstore-config
23992024-12-12T04:12:06.504ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35169
24002024-12-12T04:12:06.504ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35169 req_id = 05b81737-ed6c-423d-ad56-7b615c7100bb response_code = 200 uri = /baseboard
24012024-12-12T04:12:08.919ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7317 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = bacf673c-3246-44eb-95cd-e417e5034d14 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
24022024-12-12T04:12:13.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62617
24032024-12-12T04:12:13.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62617 req_id = 0a319fb5-2394-435c-861f-fa56c392691e response_code = 200 uri = /vpc-routes
24042024-12-12T04:12:13.076ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
24052024-12-12T04:12:13.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62617 req_id = 4a9a5461-d022-4928-963b-6c99b2c88aa4 response_code = 204 uri = /eip-gateways
24062024-12-12T04:12:13.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48640
24072024-12-12T04:12:13.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48640 req_id = e26c764b-7a4f-4d2e-b4ab-9ebd9b53a5ab response_code = 200 uri = /v2p
24082024-12-12T04:12:13.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62617 req_id = ee8c686c-5126-4eef-bdcb-1d03f91af350 response_code = 204 uri = /vpc-routes
24092024-12-12T04:12:13.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32773
24102024-12-12T04:12:13.194ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24112024-12-12T04:12:13.229ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24122024-12-12T04:12:13.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88486 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32773 req_id = 9be397b7-4201-43ad-b713-d45167d04519 response_code = 204 uri = /switch-ports
24132024-12-12T04:12:13.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32773 req_id = 5e6e4202-aaee-4214-bc74-9949999c7089 response_code = 200 uri = /network-bootstore-config
24142024-12-12T04:12:14.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47706
24152024-12-12T04:12:14.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47706 req_id = 720d68f0-759c-4718-8b00-247bd06a2984 response_code = 200 uri = /vpc-routes
24162024-12-12T04:12:14.182ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
24172024-12-12T04:12:14.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47706 req_id = 6716f6b7-4148-4c6d-8960-d065676c6877 response_code = 204 uri = /eip-gateways
24182024-12-12T04:12:14.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47706 req_id = 66f13f66-794d-4303-a9bf-31ce62b396e2 response_code = 204 uri = /vpc-routes
24192024-12-12T04:12:14.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42214
24202024-12-12T04:12:14.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42214 req_id = 79969a0d-37e8-45b3-b04c-658078b5c0c8 response_code = 200 uri = /v2p
24212024-12-12T04:12:14.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59063
24222024-12-12T04:12:14.258ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24232024-12-12T04:12:14.296ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24242024-12-12T04:12:14.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59063 req_id = ad9d69f7-4edc-4200-bb3f-4c451384f925 response_code = 204 uri = /switch-ports
24252024-12-12T04:12:14.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59063 req_id = e47de4a6-275a-43ee-acda-74ff665ab1d0 response_code = 200 uri = /network-bootstore-config
24262024-12-12T04:12:14.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59102
24272024-12-12T04:12:14.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59102 req_id = cddfd875-fdde-49e3-b019-79aa2510a966 response_code = 200 uri = /vpc-routes
24282024-12-12T04:12:14.792ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
24292024-12-12T04:12:14.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59102 req_id = dc9d0a46-aed6-471e-bd54-c91b42a7f55c response_code = 204 uri = /eip-gateways
24302024-12-12T04:12:14.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59102 req_id = 54297cee-8347-4d9d-b447-0b8112866461 response_code = 204 uri = /vpc-routes
24312024-12-12T04:12:14.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46040
24322024-12-12T04:12:14.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24332024-12-12T04:12:14.866ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24342024-12-12T04:12:14.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46040 req_id = 0a37a545-4343-42bb-87bd-3440e8f3549c response_code = 204 uri = /switch-ports
24352024-12-12T04:12:14.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42373
24362024-12-12T04:12:14.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46040 req_id = a9366c01-3cfc-4d35-880b-e569a0010b9a response_code = 200 uri = /network-bootstore-config
24372024-12-12T04:12:14.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42373 req_id = 50d9eef8-9176-45d8-9c54-a615a729bc27 response_code = 200 uri = /v2p
24382024-12-12T04:12:36.537ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65490
24392024-12-12T04:12:36.537ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65490 req_id = cc0dbb17-078f-4ab9-828d-a14efb29019b response_code = 200 uri = /baseboard
24402024-12-12T04:12:38.918ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7452 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = 5fb4f202-0d6d-4284-9e03-df0a7829d5c7 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
24412024-12-12T04:12:42.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34823
24422024-12-12T04:12:42.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34823 req_id = d1691e3b-6648-41f6-ae91-99471f84018c response_code = 200 uri = /vpc-routes
24432024-12-12T04:12:42.946ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
24442024-12-12T04:12:42.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34823 req_id = c79c5885-22f1-4b8d-9ec7-e318e006b53b response_code = 204 uri = /eip-gateways
24452024-12-12T04:12:42.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34823 req_id = 4817f40d-1daf-4852-8270-774d1b5b3326 response_code = 204 uri = /vpc-routes
24462024-12-12T04:12:43.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35908
24472024-12-12T04:12:43.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35908 req_id = f552d81f-30f3-4e55-a8b8-2342b52cfd72 response_code = 200 uri = /v2p
24482024-12-12T04:12:43.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55708
24492024-12-12T04:12:43.120ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24502024-12-12T04:12:43.157ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24512024-12-12T04:12:43.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95118 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55708 req_id = fabde84e-2bb5-4692-81b1-452474375c41 response_code = 204 uri = /switch-ports
24522024-12-12T04:12:43.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55708 req_id = 96fd38c0-d160-4152-875f-32dbad9a2566 response_code = 200 uri = /network-bootstore-config
24532024-12-12T04:12:43.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49156
24542024-12-12T04:12:43.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49156 req_id = 9d85c788-839c-4fa5-87c2-65f3eb40b1ad response_code = 200 uri = /vpc-routes
24552024-12-12T04:12:43.828ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
24562024-12-12T04:12:43.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49156 req_id = 0a3978b1-2b74-41d2-90ee-10e11f92cf6c response_code = 204 uri = /eip-gateways
24572024-12-12T04:12:43.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51005
24582024-12-12T04:12:43.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51005 req_id = 75be04f0-a024-4c1b-8781-b84d3e145b6d response_code = 200 uri = /v2p
24592024-12-12T04:12:43.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49156 req_id = 02be6a68-3217-4edf-bb1a-e7da613ee0c4 response_code = 204 uri = /vpc-routes
24602024-12-12T04:12:43.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52978
24612024-12-12T04:12:43.989ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24622024-12-12T04:12:44.028ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24632024-12-12T04:12:44.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95606 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52978 req_id = b629f679-18c0-4ba5-848e-66a12a19d9f5 response_code = 204 uri = /switch-ports
24642024-12-12T04:12:44.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52978 req_id = 5d3e227d-4c45-412a-b031-4cab7102e0a9 response_code = 200 uri = /network-bootstore-config
24652024-12-12T04:12:44.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41983
24662024-12-12T04:12:44.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41983 req_id = 774375de-79e8-4561-8bff-2bc7e522d6a1 response_code = 200 uri = /vpc-routes
24672024-12-12T04:12:44.527ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
24682024-12-12T04:12:44.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41983 req_id = f09a7688-4bec-4d0f-b637-514f097e8a66 response_code = 204 uri = /eip-gateways
24692024-12-12T04:12:44.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41983 req_id = 13431449-c3b2-417b-877d-aa699ad006d1 response_code = 204 uri = /vpc-routes
24702024-12-12T04:12:44.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33597
24712024-12-12T04:12:44.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33597 req_id = 1448f281-3ec0-4a9c-82df-b0eeeeb1972f response_code = 200 uri = /v2p
24722024-12-12T04:12:44.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37405
24732024-12-12T04:12:44.593ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24742024-12-12T04:12:44.629ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24752024-12-12T04:12:44.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37405 req_id = f2ac545c-48c8-4e64-90db-f21a5e888f1b response_code = 204 uri = /switch-ports
24762024-12-12T04:12:44.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37405 req_id = 38eba40c-8118-4bf5-aece-16caf1ed0a98 response_code = 200 uri = /network-bootstore-config
24772024-12-12T04:13:06.573ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60065
24782024-12-12T04:13:06.574ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60065 req_id = 89e285dd-ea7c-4807-bc78-310779e39328 response_code = 200 uri = /baseboard
24792024-12-12T04:13:08.919ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8030 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = 68e00241-7803-4fb3-a7aa-7ca9cec745c9 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
24802024-12-12T04:13:13.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48393
24812024-12-12T04:13:13.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48393 req_id = 76aa04c5-7da4-4056-b519-5b30af5866aa response_code = 200 uri = /vpc-routes
24822024-12-12T04:13:13.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
24832024-12-12T04:13:13.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48393 req_id = 094603cc-6b8f-4391-831f-98c37292495e response_code = 204 uri = /eip-gateways
24842024-12-12T04:13:13.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48393 req_id = b73cde15-ca05-4c7d-b521-dc96d103a5ef response_code = 204 uri = /vpc-routes
24852024-12-12T04:13:13.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58797
24862024-12-12T04:13:13.210ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24872024-12-12T04:13:13.252ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24882024-12-12T04:13:13.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94794 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58797 req_id = 5004c033-8d8b-4980-aaa0-4fb2a6e626e0 response_code = 204 uri = /switch-ports
24892024-12-12T04:13:13.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48510
24902024-12-12T04:13:13.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58797 req_id = 97f37536-096e-41ed-bfd5-3c125a8160a6 response_code = 200 uri = /network-bootstore-config
24912024-12-12T04:13:13.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48510 req_id = 543f471c-b5f1-465e-a244-1eead064fc64 response_code = 200 uri = /v2p
24922024-12-12T04:13:13.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50885
24932024-12-12T04:13:13.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50885 req_id = 11222163-df13-498c-9809-2bbb8db30298 response_code = 200 uri = /vpc-routes
24942024-12-12T04:13:13.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
24952024-12-12T04:13:13.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50885 req_id = 5690b372-f5b0-496f-a2d5-0d909e184910 response_code = 204 uri = /eip-gateways
24962024-12-12T04:13:13.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50885 req_id = f1778cf9-e701-40ad-9635-8474e2137a40 response_code = 204 uri = /vpc-routes
24972024-12-12T04:13:14.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45775
24982024-12-12T04:13:14.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45775 req_id = 5687e87a-0f17-45a9-8c0a-de3ec3997e31 response_code = 200 uri = /v2p
24992024-12-12T04:13:14.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40579
25002024-12-12T04:13:14.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25012024-12-12T04:13:14.196ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25022024-12-12T04:13:14.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86796 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40579 req_id = a5ca31aa-d421-401c-a745-1647fe822285 response_code = 204 uri = /switch-ports
25032024-12-12T04:13:14.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40579 req_id = 36525734-38af-4e8e-880b-a2eb8d250532 response_code = 200 uri = /network-bootstore-config
25042024-12-12T04:13:14.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32960
25052024-12-12T04:13:14.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32960 req_id = 9532d071-cf3a-46b2-b859-dd86440245df response_code = 200 uri = /v2p
25062024-12-12T04:13:14.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56236
25072024-12-12T04:13:14.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56236 req_id = 9941d36d-44ce-4d1e-81a8-f9f668427dcf response_code = 200 uri = /vpc-routes
25082024-12-12T04:13:14.915ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
25092024-12-12T04:13:14.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56236 req_id = 906e3704-c330-4d03-8c25-941bce2f82fc response_code = 204 uri = /eip-gateways
25102024-12-12T04:13:14.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56236 req_id = 5488a47b-c11b-4d88-8215-a983d17dd36c response_code = 204 uri = /vpc-routes
25112024-12-12T04:13:14.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47590
25122024-12-12T04:13:14.938ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25132024-12-12T04:13:14.978ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25142024-12-12T04:13:15.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95441 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47590 req_id = 04fb3fc4-dd51-4339-8bf6-add85ed52209 response_code = 204 uri = /switch-ports
25152024-12-12T04:13:15.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47590 req_id = 31dcc094-0652-4c27-993b-db36d5fcf54d response_code = 200 uri = /network-bootstore-config
25162024-12-12T04:13:36.605ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41353
25172024-12-12T04:13:36.605ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41353 req_id = 92c58034-00e3-4807-bebf-21192bb10e25 response_code = 200 uri = /baseboard
25182024-12-12T04:13:38.918ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6183 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = 7df3fd94-aee6-4ad2-9627-39c5818e5002 response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
25192024-12-12T04:13:42.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58706
25202024-12-12T04:13:42.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58706 req_id = 8df9db8b-e6d8-4c47-9520-f9b593544d22 response_code = 200 uri = /v2p
25212024-12-12T04:13:42.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48761
25222024-12-12T04:13:42.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48761 req_id = e510dd3c-0e19-4312-b267-74cbb15edd0e response_code = 200 uri = /vpc-routes
25232024-12-12T04:13:43.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
25242024-12-12T04:13:43.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48761 req_id = c6c96209-60df-47a7-a75a-3f9ccdc323b0 response_code = 204 uri = /eip-gateways
25252024-12-12T04:13:43.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48761 req_id = 3bd3ff00-45b0-4c6e-9f55-fc325644d8f1 response_code = 204 uri = /vpc-routes
25262024-12-12T04:13:43.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50096
25272024-12-12T04:13:43.037ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25282024-12-12T04:13:43.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25292024-12-12T04:13:43.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50096 req_id = f5d3934a-7be8-48cd-8128-cee27edbea68 response_code = 204 uri = /switch-ports
25302024-12-12T04:13:43.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50096 req_id = f1e51811-e80f-4bda-8cbc-d7a8a21d7f3e response_code = 200 uri = /network-bootstore-config
25312024-12-12T04:13:43.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42644
25322024-12-12T04:13:43.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42644 req_id = 8f009870-7094-4403-99bc-cf63de3cda44 response_code = 200 uri = /vpc-routes
25332024-12-12T04:13:43.816ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
25342024-12-12T04:13:43.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42644 req_id = cbe83e8c-2b52-4891-834e-f20c4451c618 response_code = 204 uri = /eip-gateways
25352024-12-12T04:13:43.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42644 req_id = a9cf12ff-f153-402d-97ae-b40dc5dcd803 response_code = 204 uri = /vpc-routes
25362024-12-12T04:13:43.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39550
25372024-12-12T04:13:43.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39550 req_id = e1fdd36a-b2e2-40e3-9e32-e695427ff7ee response_code = 200 uri = /v2p
25382024-12-12T04:13:43.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43377
25392024-12-12T04:13:43.992ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25402024-12-12T04:13:44.031ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25412024-12-12T04:13:44.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43377 req_id = bebe7017-ede8-4d3d-bc78-0920b874e0da response_code = 204 uri = /switch-ports
25422024-12-12T04:13:44.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43377 req_id = 3051a43d-117b-41ce-85fc-abca10fed005 response_code = 200 uri = /network-bootstore-config
25432024-12-12T04:13:44.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44346
25442024-12-12T04:13:44.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44346 req_id = 75b55076-807f-42bd-be9c-5af6c252bab5 response_code = 200 uri = /vpc-routes
25452024-12-12T04:13:44.532ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
25462024-12-12T04:13:44.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44346 req_id = 0eb8eb49-564f-46e4-b915-167c888d0422 response_code = 204 uri = /eip-gateways
25472024-12-12T04:13:44.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44346 req_id = 38364190-bf6a-4eda-af14-caf156ef5543 response_code = 204 uri = /vpc-routes
25482024-12-12T04:13:44.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37357
25492024-12-12T04:13:44.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37357 req_id = 52cc83fa-052d-4757-9ed6-8c2c874998ed response_code = 200 uri = /v2p
25502024-12-12T04:13:44.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39813
25512024-12-12T04:13:44.779ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25522024-12-12T04:13:44.816ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25532024-12-12T04:13:44.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91144 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39813 req_id = bef751c7-3bb2-42b4-9119-d5e201cf32d1 response_code = 204 uri = /switch-ports
25542024-12-12T04:13:44.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39813 req_id = b8ee4fea-6347-4d2e-a6e3-558a58cd4aa3 response_code = 200 uri = /network-bootstore-config
25552024-12-12T04:14:06.639ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43502
25562024-12-12T04:14:06.639ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43502 req_id = ddb13bdd-2efe-4705-9938-0376caca2114 response_code = 200 uri = /baseboard
25572024-12-12T04:14:08.918ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6624 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = a49e4735-919e-45a4-8c8c-1c60c61279bf response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
25582024-12-12T04:14:12.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52011
25592024-12-12T04:14:12.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52011 req_id = 6ee4fe00-011c-4a4a-b29f-39647478e849 response_code = 200 uri = /vpc-routes
25602024-12-12T04:14:13.036ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
25612024-12-12T04:14:13.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52011 req_id = ebee62ff-e9e0-4826-8e97-c1bd91652cd3 response_code = 204 uri = /eip-gateways
25622024-12-12T04:14:13.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52011 req_id = 104a2391-f2f2-4223-9d96-e53a8ffc784f response_code = 204 uri = /vpc-routes
25632024-12-12T04:14:13.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48038
25642024-12-12T04:14:13.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48038 req_id = c337a59e-327a-4028-994b-b56d9949f0ef response_code = 200 uri = /v2p
25652024-12-12T04:14:13.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39012
25662024-12-12T04:14:13.198ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25672024-12-12T04:14:13.237ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25682024-12-12T04:14:13.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93148 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39012 req_id = 10b6fa79-2127-4c6b-9ac9-5373097b4e4b response_code = 204 uri = /switch-ports
25692024-12-12T04:14:13.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53461
25702024-12-12T04:14:13.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39012 req_id = 98f4d157-8313-4aca-934f-9c927c7adda8 response_code = 200 uri = /network-bootstore-config
25712024-12-12T04:14:13.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25722024-12-12T04:14:13.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25732024-12-12T04:14:13.295ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-zones.json file = common/src/ledger.rs:177
25742024-12-12T04:14:13.295ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-zones.json file = common/src/ledger.rs:177
25752024-12-12T04:14:13.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52890
25762024-12-12T04:14:13.303ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25772024-12-12T04:14:13.303ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25782024-12-12T04:14:13.303ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25792024-12-12T04:14:13.303ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25802024-12-12T04:14:13.303ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25812024-12-12T04:14:13.303ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25822024-12-12T04:14:13.303ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25832024-12-12T04:14:13.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52890 req_id = ee4ff67f-cfa7-4107-a744-1313745a3ef4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25842024-12-12T04:14:13.307ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25852024-12-12T04:14:13.307ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071
25862024-12-12T04:14:13.332ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25872024-12-12T04:14:13.332ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46
25882024-12-12T04:14:13.353ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25892024-12-12T04:14:13.353ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb
25902024-12-12T04:14:13.374ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25912024-12-12T04:14:13.374ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47
25922024-12-12T04:14:13.395ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25932024-12-12T04:14:13.395ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4
25942024-12-12T04:14:13.416ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25952024-12-12T04:14:13.416ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4b8ca783-c0e0-4c3f-a149-be038075af29
25962024-12-12T04:14:13.436ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25972024-12-12T04:14:13.436ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2
25982024-12-12T04:14:13.456ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25992024-12-12T04:14:13.456ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f
26002024-12-12T04:14:13.475ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26012024-12-12T04:14:13.475ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2ce90261-9b65-4601-b849-599cec034d39
26022024-12-12T04:14:13.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53461 req_id = b8b78b9f-bcca-4336-b2ba-8600009d9422 response_code = 200 uri = /inventory
26032024-12-12T04:14:14.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57294
26042024-12-12T04:14:14.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57294 req_id = 6fa37c7e-18ff-4b12-9baa-bb5f459e99f4 response_code = 200 uri = /vpc-routes
26052024-12-12T04:14:14.058ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
26062024-12-12T04:14:14.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57294 req_id = b27e55b8-dad2-4272-bc73-e4e3e1408cb7 response_code = 204 uri = /eip-gateways
26072024-12-12T04:14:14.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57294 req_id = f81ed4e8-d365-4192-b7d2-b0dc2f21be4c response_code = 204 uri = /vpc-routes
26082024-12-12T04:14:14.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38507
26092024-12-12T04:14:14.195ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26102024-12-12T04:14:14.195ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26112024-12-12T04:14:14.195ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-zones.json file = common/src/ledger.rs:177
26122024-12-12T04:14:14.195ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-zones.json file = common/src/ledger.rs:177
26132024-12-12T04:14:14.207ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26142024-12-12T04:14:14.207ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071
26152024-12-12T04:14:14.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39451
26162024-12-12T04:14:14.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39451 req_id = 5736bd81-b26a-439c-8246-ae1af227a056 response_code = 200 uri = /v2p
26172024-12-12T04:14:14.230ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26182024-12-12T04:14:14.230ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46
26192024-12-12T04:14:14.252ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26202024-12-12T04:14:14.252ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb
26212024-12-12T04:14:14.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35636
26222024-12-12T04:14:14.266ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26232024-12-12T04:14:14.282ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26242024-12-12T04:14:14.282ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47
26252024-12-12T04:14:14.305ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26262024-12-12T04:14:14.308ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26272024-12-12T04:14:14.308ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4
26282024-12-12T04:14:14.333ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26292024-12-12T04:14:14.333ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4b8ca783-c0e0-4c3f-a149-be038075af29
26302024-12-12T04:14:14.363ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26312024-12-12T04:14:14.364ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2
26322024-12-12T04:14:14.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114709 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35636 req_id = a84ad5f2-e4a5-4e54-8bd5-fdc3ae304c94 response_code = 204 uri = /switch-ports
26332024-12-12T04:14:14.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35636 req_id = ee3924be-4fd2-4c74-9fcf-4137d0a8226f response_code = 200 uri = /network-bootstore-config
26342024-12-12T04:14:14.406ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26352024-12-12T04:14:14.406ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f
26362024-12-12T04:14:14.439ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26372024-12-12T04:14:14.439ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2ce90261-9b65-4601-b849-599cec034d39
26382024-12-12T04:14:14.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38507 req_id = 7680309a-0443-4dc1-894e-358f60c381cb response_code = 200 uri = /inventory
26392024-12-12T04:14:14.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59263
26402024-12-12T04:14:14.463ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26412024-12-12T04:14:14.463ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26422024-12-12T04:14:14.463ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26432024-12-12T04:14:14.463ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26442024-12-12T04:14:14.463ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26452024-12-12T04:14:14.463ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26462024-12-12T04:14:14.463ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26472024-12-12T04:14:14.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59263 req_id = cf28bf04-2b11-4d75-afcb-c4b220c81a57 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26482024-12-12T04:14:14.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53561
26492024-12-12T04:14:14.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53561 req_id = ff078328-2cef-4e71-8381-b8efe2ac8c50 response_code = 200 uri = /vpc-routes
26502024-12-12T04:14:14.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
26512024-12-12T04:14:14.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53561 req_id = 33a2b219-27bf-41ac-8420-1f32d765737a response_code = 204 uri = /eip-gateways
26522024-12-12T04:14:14.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53561 req_id = 5b337bb4-41ca-4cce-8150-9c91d8758dbd response_code = 204 uri = /vpc-routes
26532024-12-12T04:14:14.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48057
26542024-12-12T04:14:14.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48057 req_id = 7b7abc64-5353-4267-9881-5a8e9b23889a response_code = 200 uri = /v2p
26552024-12-12T04:14:14.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44946
26562024-12-12T04:14:14.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26572024-12-12T04:14:14.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26582024-12-12T04:14:14.952ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/config/omicron-zones.json file = common/src/ledger.rs:177
26592024-12-12T04:14:14.952ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/config/omicron-zones.json file = common/src/ledger.rs:177
26602024-12-12T04:14:14.964ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52ff5631-9ac0-4ac7-86b7-64ca5116a071 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26612024-12-12T04:14:14.965ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_52ff5631-9ac0-4ac7-86b7-64ca5116a071
26622024-12-12T04:14:14.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61841
26632024-12-12T04:14:14.983ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 418f0b92-89c3-4081-80db-c6859ed8ae21, kind: Service { id: 9bb732d7-5c6c-418e-9bb4-2b78363c496b }, name: Name("external-dns-9bb732d7-5c6c-418e-9bb4-2b78363c496b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 233])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed7bfea0-7e5d-4d9a-b1dc-17fadc8bd515, kind: Service { id: a6e7ea12-5d7a-4497-b4c7-99b34dca3373 }, name: Name("external-dns-a6e7ea12-5d7a-4497-b4c7-99b34dca3373"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bac288-b547-49b2-af15-904789a7cb38, kind: Service { id: 5a2da4c3-1dce-4828-9073-a93ecc67e115 }, name: Name("nexus-5a2da4c3-1dce-4828-9073-a93ecc67e115"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 251])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 97897984-7c73-42ae-8b0b-eaf9a2bc7479, kind: Service { id: 1d05500b-26d9-4871-8794-d746af81cddf }, name: Name("nexus-1d05500b-26d9-4871-8794-d746af81cddf"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6e9116-cfc4-4b3e-98be-2bb67d110731, kind: Service { id: 4a50bf12-1fdc-4917-8d03-ca85c9fb72af }, name: Name("nexus-4a50bf12-1fdc-4917-8d03-ca85c9fb72af"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26642024-12-12T04:14:14.983ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26652024-12-12T04:14:14.983ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26662024-12-12T04:14:14.983ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26672024-12-12T04:14:14.983ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26682024-12-12T04:14:14.983ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26692024-12-12T04:14:14.983ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26702024-12-12T04:14:14.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61841 req_id = afdc1976-3230-4140-90fd-33b3c221c364 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26712024-12-12T04:14:14.988ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 10da5ed2-63d5-4960-a7ed-e0f22ea11d46 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26722024-12-12T04:14:14.988ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_10da5ed2-63d5-4960-a7ed-e0f22ea11d46
26732024-12-12T04:14:15.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54581
26742024-12-12T04:14:15.003ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26752024-12-12T04:14:15.010ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26762024-12-12T04:14:15.010ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb
26772024-12-12T04:14:15.031ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb2d454c-3596-42d0-8ff3-f8219d6e3f47 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26782024-12-12T04:14:15.031ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb2d454c-3596-42d0-8ff3-f8219d6e3f47
26792024-12-12T04:14:15.039ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26802024-12-12T04:14:15.052ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 23c36e6b-2f3a-43bc-b874-06ee7fff36f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26812024-12-12T04:14:15.052ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_23c36e6b-2f3a-43bc-b874-06ee7fff36f4
26822024-12-12T04:14:15.075ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b8ca783-c0e0-4c3f-a149-be038075af29 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26832024-12-12T04:14:15.075ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4b8ca783-c0e0-4c3f-a149-be038075af29
26842024-12-12T04:14:15.095ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4c2dd18b-2445-4d2c-acfe-6708713b37f2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26852024-12-12T04:14:15.095ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4c2dd18b-2445-4d2c-acfe-6708713b37f2
26862024-12-12T04:14:15.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97487 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54581 req_id = 940f3fac-0582-468f-84d0-ff6c5811b2f4 response_code = 204 uri = /switch-ports
26872024-12-12T04:14:15.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54581 req_id = d9259dbc-2d11-4f76-9a2e-d1b6c92e31d4 response_code = 200 uri = /network-bootstore-config
26882024-12-12T04:14:15.120ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f09e596-8c3b-4084-9722-b9e187b46c0f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26892024-12-12T04:14:15.120ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1f09e596-8c3b-4084-9722-b9e187b46c0f
26902024-12-12T04:14:15.141ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2ce90261-9b65-4601-b849-599cec034d39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26912024-12-12T04:14:15.141ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2ce90261-9b65-4601-b849-599cec034d39
26922024-12-12T04:14:15.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200563 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44946 req_id = bdd45009-6e1d-4cc2-b2ea-675af3dc8b94 response_code = 200 uri = /inventory
26932024-12-12T04:14:36.672ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59888
26942024-12-12T04:14:36.672ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59888 req_id = 15d487d7-08bc-48f5-a26e-f2042e861ff2 response_code = 200 uri = /baseboard
26952024-12-12T04:14:38.917ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6540 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = a17bf033-b1a0-430c-9a01-6c15962a619d response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
26962024-12-12T04:14:43.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40245
26972024-12-12T04:14:43.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40245 req_id = 645901ae-af8c-4889-beb4-664faa4a7f2d response_code = 200 uri = /v2p
26982024-12-12T04:14:43.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41648
26992024-12-12T04:14:43.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41648 req_id = 6e887d12-90f9-49fd-8200-f7a1bb373fa2 response_code = 200 uri = /vpc-routes
27002024-12-12T04:14:43.091ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
27012024-12-12T04:14:43.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41648 req_id = 29ba22f7-a630-4731-b786-396f6b290889 response_code = 204 uri = /eip-gateways
27022024-12-12T04:14:43.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41648 req_id = 94cfb0d9-b0e4-49c7-9933-eee98db98e8b response_code = 204 uri = /vpc-routes
27032024-12-12T04:14:43.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37060
27042024-12-12T04:14:43.118ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27052024-12-12T04:14:43.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27062024-12-12T04:14:43.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87876 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37060 req_id = 729f828d-67c9-46f0-9baa-ae0d65948798 response_code = 204 uri = /switch-ports
27072024-12-12T04:14:43.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37060 req_id = c18173a2-f74b-44d1-939b-c717b468ef75 response_code = 200 uri = /network-bootstore-config
27082024-12-12T04:14:43.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45674
27092024-12-12T04:14:43.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45674 req_id = 5f1dd92e-ea0b-4afd-8ef5-e726bc0959ac response_code = 200 uri = /vpc-routes
27102024-12-12T04:14:43.918ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
27112024-12-12T04:14:43.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45674 req_id = 4a6865b3-0916-48c7-8d93-d378ccc7c832 response_code = 204 uri = /eip-gateways
27122024-12-12T04:14:43.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45674 req_id = 4fce8ea1-e332-4417-a042-7dea476203a5 response_code = 204 uri = /vpc-routes
27132024-12-12T04:14:43.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56387
27142024-12-12T04:14:43.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56387 req_id = ab8ecaec-0d0b-4fdc-8927-22525fafa9a1 response_code = 200 uri = /v2p
27152024-12-12T04:14:44.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59376
27162024-12-12T04:14:44.028ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27172024-12-12T04:14:44.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27182024-12-12T04:14:44.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91875 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59376 req_id = cf12af11-a840-46d7-8c0e-34fb4175eebf response_code = 204 uri = /switch-ports
27192024-12-12T04:14:44.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59376 req_id = 7a18349c-e181-44ac-a991-c1814bd63922 response_code = 200 uri = /network-bootstore-config
27202024-12-12T04:14:44.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33199
27212024-12-12T04:14:44.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33199 req_id = 35c2bac4-c06b-434e-9a0b-fa03ca4f7737 response_code = 200 uri = /vpc-routes
27222024-12-12T04:14:44.535ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
27232024-12-12T04:14:44.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33199 req_id = 563f45e5-9bb3-49c4-a7f4-40a6acf79172 response_code = 204 uri = /eip-gateways
27242024-12-12T04:14:44.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39522
27252024-12-12T04:14:44.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39522 req_id = dfab1f93-1ca7-4451-a43a-9a8d0dc9a86a response_code = 200 uri = /v2p
27262024-12-12T04:14:44.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33199 req_id = b64019eb-a9a4-44df-b093-9223b5aff452 response_code = 204 uri = /vpc-routes
27272024-12-12T04:14:44.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51635
27282024-12-12T04:14:44.671ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27292024-12-12T04:14:44.706ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27302024-12-12T04:14:44.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91026 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51635 req_id = 7b1e8c5b-550a-427d-a9f6-e66ad459cc1a response_code = 204 uri = /switch-ports
27312024-12-12T04:14:44.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51635 req_id = 826cb819-bff1-4aa3-81df-b66b660be451 response_code = 200 uri = /network-bootstore-config
27322024-12-12T04:14:55.874ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
27332024-12-12T04:15:06.704ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62137
27342024-12-12T04:15:06.705ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62137 req_id = f67b110f-2d04-4f9c-87ec-e6906542b2b7 response_code = 200 uri = /baseboard
27352024-12-12T04:15:08.918ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6797 local_addr = [fd00:1122:3344:101::1]:43012 method = GET remote_addr = [fd00:1122:3344:101::d]:42324 req_id = a94a4f6c-718e-4cf1-adcf-89c9dd9126af response_code = 200 sled_id = 80af691a-30bb-4399-8524-a68071b516df uri = /80af691a-30bb-4399-8524-a68071b516df
27362024-12-12T04:15:12.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57954
27372024-12-12T04:15:12.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57954 req_id = 2374dfa4-fb06-430b-adad-0fe4c10c842b response_code = 200 uri = /v2p
27382024-12-12T04:15:12.414ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14274613) }
27392024-12-12T04:15:12.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57954 req_id = 9dba3c05-3178-46da-afbe-c6549c4652eb response_code = 204 uri = /v2p
27402024-12-12T04:15:12.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57481
27412024-12-12T04:15:12.559ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: b48a8044-86aa-4806-a0d7-ac26510a9a0d, kind: Instance { id: f2240917-cf4b-415f-8bd0-1a242c50516f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14274613), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b48a8044-86aa-4806-a0d7-ac26510a9a0d, kind: Instance { id: f2240917-cf4b-415f-8bd0-1a242c50516f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14274613), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b48a8044-86aa-4806-a0d7-ac26510a9a0d, kind: Instance { id: f2240917-cf4b-415f-8bd0-1a242c50516f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14274613), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14274613))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b48a8044-86aa-4806-a0d7-ac26510a9a0d, kind: Instance { id: f2240917-cf4b-415f-8bd0-1a242c50516f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14274613), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-66dc306c887", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5c29ea4d-74b5-4b47-abda-89cb52e7f5ba, read_only_parent: Some(Volume { block_size: 512, id: 1575b977-ed68-4bde-8138-a4ad74ca9f6f, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6d813c21-9432-48f5-a2e1-34beee5d6647, key: Some("F/Y+JGClBDkFyi8I9IIy/cqjp8/W5uKWAsl2+KC1ykk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5c29ea4d-74b5-4b47-abda-89cb52e7f5ba, key: Some("NxjTa6rNMGxNIQ+mdI365X4Bvzo9QyDNL17pcRCJGDw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-66dc306c887" }] }), cloud_init_bytes: Some(..) } instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f metadata = InstanceMetadata { silo_id: 46bdf509-11b9-47c6-9aa0-67e689dc84db, project_id: 4c90e50e-54d5-401d-99f5-b8095a35e8ac } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-12T04:15:12.556290649Z }
27422024-12-12T04:15:12.560ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f migration_id = None propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
27432024-12-12T04:15:12.560ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f migration_id = None propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: b48a8044-86aa-4806-a0d7-ac26510a9a0d, kind: Instance { id: f2240917-cf4b-415f-8bd0-1a242c50516f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14274613), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b48a8044-86aa-4806-a0d7-ac26510a9a0d, kind: Instance { id: f2240917-cf4b-415f-8bd0-1a242c50516f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14274613), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b48a8044-86aa-4806-a0d7-ac26510a9a0d, kind: Instance { id: f2240917-cf4b-415f-8bd0-1a242c50516f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14274613), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14274613))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b48a8044-86aa-4806-a0d7-ac26510a9a0d, kind: Instance { id: f2240917-cf4b-415f-8bd0-1a242c50516f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14274613), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-66dc306c887", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5c29ea4d-74b5-4b47-abda-89cb52e7f5ba, read_only_parent: Some(Volume { block_size: 512, id: 1575b977-ed68-4bde-8138-a4ad74ca9f6f, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6d813c21-9432-48f5-a2e1-34beee5d6647, key: Some("F/Y+JGClBDkFyi8I9IIy/cqjp8/W5uKWAsl2+KC1ykk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5c29ea4d-74b5-4b47-abda-89cb52e7f5ba, key: Some("NxjTa6rNMGxNIQ+mdI365X4Bvzo9QyDNL17pcRCJGDw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-66dc306c887" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-12T04:15:12.556290649Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27442024-12-12T04:15:12.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3964 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57481 req_id = a52a0471-18c9-46e9-9b75-66068c826ef0 response_code = 200 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4
27452024-12-12T04:15:12.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64151
27462024-12-12T04:15:12.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 952 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64151 req_id = ce381b2e-40ff-41f1-b1b0-d077ae589ee9 response_code = 200 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4/state
27472024-12-12T04:15:12.669ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 14274613 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27482024-12-12T04:15:12.669ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27492024-12-12T04:15:12.709ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4 file = illumos-utils/src/zone.rs:325 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
27502024-12-12T04:15:12.751ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4 file = illumos-utils/src/zone.rs:363 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
27512024-12-12T04:15:12.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63499
27522024-12-12T04:15:12.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63499 req_id = af64bfab-6728-4660-a391-b3d007ecc4e7 response_code = 200 uri = /vpc-routes
27532024-12-12T04:15:12.879ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {b48a8044-86aa-4806-a0d7-ac26510a9a0d: {10.151.1.176: {7b3d8a48-44ad-4338-9f06-f8800312ec5b}, 10.151.1.175: {7b3d8a48-44ad-4338-9f06-f8800312ec5b}}} }
27542024-12-12T04:15:12.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61056
27552024-12-12T04:15:13.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59509
27562024-12-12T04:15:13.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59509 req_id = 29ab0bdb-0dba-43e1-a936-9c1f57e472f7 response_code = 200 uri = /vpc-routes
27572024-12-12T04:15:13.115ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {b48a8044-86aa-4806-a0d7-ac26510a9a0d: {10.151.1.175: {7b3d8a48-44ad-4338-9f06-f8800312ec5b}, 10.151.1.176: {7b3d8a48-44ad-4338-9f06-f8800312ec5b}}} }
27582024-12-12T04:15:13.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59509 req_id = 1fc30c70-b073-48d8-a80d-22e75cc58724 response_code = 204 uri = /eip-gateways
27592024-12-12T04:15:13.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56592
27602024-12-12T04:15:13.171ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27612024-12-12T04:15:13.231ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27622024-12-12T04:15:13.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141729 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56592 req_id = 000837dd-2485-4f5b-b083-252aab5b9666 response_code = 204 uri = /switch-ports
27632024-12-12T04:15:13.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39526
27642024-12-12T04:15:13.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39526 req_id = b45a30cc-6f5e-47b7-bcd9-7fb9baeb6185 response_code = 200 uri = /v2p
27652024-12-12T04:15:13.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56592 req_id = e5aa91cf-a1db-43f1-bbd6-1a214caab3be response_code = 200 uri = /network-bootstore-config
27662024-12-12T04:15:13.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 906 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59509 req_id = a4200345-e2f8-4b96-a2a7-e64b6eba035d response_code = 204 uri = /vpc-routes
27672024-12-12T04:15:13.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50508
27682024-12-12T04:15:14.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45307
27692024-12-12T04:15:14.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45307 req_id = 4784a299-0d05-477b-b3e5-51115cb4f11d response_code = 200 uri = /vpc-routes
27702024-12-12T04:15:14.225ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {b48a8044-86aa-4806-a0d7-ac26510a9a0d: {10.151.1.175: {7b3d8a48-44ad-4338-9f06-f8800312ec5b}, 10.151.1.176: {7b3d8a48-44ad-4338-9f06-f8800312ec5b}}} }
27712024-12-12T04:15:14.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45307 req_id = ee9052bd-254d-477a-86f3-c2a248ffafab response_code = 204 uri = /eip-gateways
27722024-12-12T04:15:14.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45307 req_id = 62dc30c0-b27b-49eb-b691-47634d663352 response_code = 204 uri = /vpc-routes
27732024-12-12T04:15:14.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38588
27742024-12-12T04:15:14.271ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27752024-12-12T04:15:14.325ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27762024-12-12T04:15:14.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160325 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38588 req_id = fb18de43-6253-46ed-a3e3-0ad3f1c02864 response_code = 204 uri = /switch-ports
27772024-12-12T04:15:14.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54749
27782024-12-12T04:15:14.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38588 req_id = b7bd1b7e-c86f-4fef-8f41-d31a82f84ce2 response_code = 200 uri = /network-bootstore-config
27792024-12-12T04:15:14.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54749 req_id = c6b8e991-fb2c-4ea8-80d1-f6d6b5738bbf response_code = 200 uri = /v2p
27802024-12-12T04:15:14.530ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
27812024-12-12T04:15:14.531ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4 zone file = illumos-utils/src/running_zone.rs:488 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 zone = oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4
27822024-12-12T04:15:14.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59240
27832024-12-12T04:15:14.717ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 43.37746ms file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 zone = oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4
27842024-12-12T04:15:14.768ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 75.402775ms file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 zone = oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4
27852024-12-12T04:15:14.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62165
27862024-12-12T04:15:14.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62165 req_id = 61b554e4-c31e-499f-be4f-38239417a1f2 response_code = 200 uri = /v2p
27872024-12-12T04:15:14.858ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 277.739188ms file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 zone = oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4
27882024-12-12T04:15:14.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52990
27892024-12-12T04:15:14.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27902024-12-12T04:15:14.983ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27912024-12-12T04:15:15.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149943 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52990 req_id = a6fb750e-15b8-4c0f-a2db-c8c867128a8b response_code = 204 uri = /switch-ports
27922024-12-12T04:15:15.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52990 req_id = d5a3a5e7-3d24-4b05-bfe4-3e0171bc5c20 response_code = 200 uri = /network-bootstore-config
27932024-12-12T04:15:15.152ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 555.990472ms file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 zone = oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4
27942024-12-12T04:15:15.725ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 514.926078ms file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 zone = oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4
27952024-12-12T04:15:16.250ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 1.363711822s file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 zone = oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4
27962024-12-12T04:15:17.625ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 1.363981041s file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 zone = oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4
27972024-12-12T04:15:19.000ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 622.045488ms file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 zone = oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4
27982024-12-12T04:15:19.650ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4 file = sled-agent/src/instance.rs:1786 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
27992024-12-12T04:15:19.660ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 74.310837ms file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28002024-12-12T04:15:19.745ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 86.173341ms file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28012024-12-12T04:15:19.841ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 269.895693ms file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28022024-12-12T04:15:20.122ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4") failed: Property not found. retry in 328.825218ms file = illumos-utils/src/svc.rs:36 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28032024-12-12T04:15:20.462ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28042024-12-12T04:15:20.500ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28052024-12-12T04:15:20.643ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28062024-12-12T04:15:20.643ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 80af691a-30bb-4399-8524-a68071b516df
28072024-12-12T04:15:20.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5973275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59240 req_id = 96f7931c-66c6-4f17-9001-717cd8a68b65 response_code = 200 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4/state
28082024-12-12T04:15:20.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7747516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61056 req_id = da8a2176-5989-4fbf-a0ef-b92e915681fe response_code = 200 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4/state
28092024-12-12T04:15:20.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7765680 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63499 req_id = 312226a9-1e15-4fca-8310-7244c0ec7a90 response_code = 204 uri = /eip-gateways
28102024-12-12T04:15:20.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6650914 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50508 req_id = 8774fed7-8c26-4c9e-a012-830e9aeb9a5a response_code = 200 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4/state
28112024-12-12T04:15:20.646ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-12T04:15:20.645603542Z } file = sled-agent/src/instance.rs:780 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28122024-12-12T04:15:20.647ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-12T04:15:20.645603542Z } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28132024-12-12T04:15:20.647ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-12T04:15:20.645603542Z }, migration_in: None, migration_out: None }
28142024-12-12T04:15:20.706ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-12T04:15:20.706719668Z } file = sled-agent/src/instance.rs:780 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28152024-12-12T04:15:20.706ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-12T04:15:20.706719668Z } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28162024-12-12T04:15:20.706ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-12T04:15:20.706719668Z }, migration_in: None, migration_out: None }
28172024-12-12T04:15:20.725ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 9e88d2d9-35c6-4979-b905-e22aed207201, version: 3 } old_vers = RouterVersion { router_id: 9e88d2d9-35c6-4979-b905-e22aed207201, version: 3 } subnet = RouterId { vni: Vni(14274613), kind: System }
28182024-12-12T04:15:20.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 582 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63499 req_id = 2641aa30-410f-4f12-b874-ceedbb9cae99 response_code = 204 uri = /vpc-routes
28192024-12-12T04:15:20.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49241
28202024-12-12T04:15:20.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49241 req_id = 6d75d4f7-0ab9-430e-9231-e8127792a45c response_code = 200 uri = /vpc-routes
28212024-12-12T04:15:20.783ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {b48a8044-86aa-4806-a0d7-ac26510a9a0d: {10.151.1.175: {7b3d8a48-44ad-4338-9f06-f8800312ec5b}, 10.151.1.176: {7b3d8a48-44ad-4338-9f06-f8800312ec5b}}} }
28222024-12-12T04:15:20.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49241 req_id = 8ee69805-edac-44dd-b5cf-003257c69fde response_code = 204 uri = /eip-gateways
28232024-12-12T04:15:20.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49241 req_id = 392c3752-679e-4f8b-9669-6b4fb4e60aa8 response_code = 204 uri = /vpc-routes
28242024-12-12T04:15:30.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64258
28252024-12-12T04:15:30.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 649 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64258 req_id = c7a8614b-779d-4fab-8b04-71583b5d8d59 response_code = 200 uri = /vmms/d2120084-d65f-4412-8c07-a4b2832354d4/state
28262024-12-12T04:15:30.336ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-12T04:15:30.336712259Z } file = sled-agent/src/instance.rs:780 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28272024-12-12T04:15:30.336ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-12T04:15:30.336712259Z } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28282024-12-12T04:15:30.336ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-12T04:15:30.336712259Z }, migration_in: None, migration_out: None }
28292024-12-12T04:15:30.345ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopped), migration_in: None, migration_out: None, time: 2024-12-12T04:15:30.345347294Z } file = sled-agent/src/instance.rs:780 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28302024-12-12T04:15:30.345ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2024-12-12T04:15:30.345347294Z } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28312024-12-12T04:15:30.345ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2024-12-12T04:15:30.345347294Z }, migration_in: None, migration_out: None }
28322024-12-12T04:15:30.353ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-12T04:15:30.353331723Z } file = sled-agent/src/instance.rs:780 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28332024-12-12T04:15:30.353ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-12T04:15:30.353331723Z } propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28342024-12-12T04:15:30.353ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28352024-12-12T04:15:30.353ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28362024-12-12T04:15:30.353ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28372024-12-12T04:15:30.353ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/2db2571c-c8fc-49d7-9a67-c3d98ed7f856/debug/bundle/zone", "/pool/int/c1febdee-2c98-4f12-9aa4-ad18d04436bd/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/52ff5631-9ac0-4ac7-86b7-64ca5116a071/crypt/debug", "/pool/ext/10da5ed2-63d5-4960-a7ed-e0f22ea11d46/crypt/debug", "/pool/ext/3e5f6a6a-ed05-45be-b4a3-2de8d37ccfbb/crypt/debug", "/pool/ext/fb2d454c-3596-42d0-8ff3-f8219d6e3f47/crypt/debug", "/pool/ext/23c36e6b-2f3a-43bc-b874-06ee7fff36f4/crypt/debug", "/pool/ext/4b8ca783-c0e0-4c3f-a149-be038075af29/crypt/debug", "/pool/ext/4c2dd18b-2445-4d2c-acfe-6708713b37f2/crypt/debug", "/pool/ext/1f09e596-8c3b-4084-9722-b9e187b46c0f/crypt/debug", "/pool/ext/2ce90261-9b65-4601-b849-599cec034d39/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4
28382024-12-12T04:15:30.986ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4", bundle_id: 20019215-09cb-4275-8902-ce420a949415 }, time_created: 2024-12-12T04:15:30.354457362Z, version: 0, cause: TerminatedInstance }
28392024-12-12T04:15:30.986ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_d2120084-d65f-4412-8c07-a4b2832354d4 file = sled-agent/src/instance.rs:1032 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28402024-12-12T04:15:32.766ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28412024-12-12T04:15:32.783ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(14274613), kind: System }
28422024-12-12T04:15:32.783ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(14274613), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28432024-12-12T04:15:32.784ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-12T04:15:32.784147077Z }, migration_in: None, migration_out: None }
28442024-12-12T04:15:32.877ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-12T04:15:32.784147077Z }, migration_in: None, migration_out: None }
28452024-12-12T04:15:32.882ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = f2240917-cf4b-415f-8bd0-1a242c50516f propolis_id = d2120084-d65f-4412-8c07-a4b2832354d4
28462024-12-12T04:15:33.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36209
28472024-12-12T04:15:33.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36209 req_id = c092c8f0-eae9-454f-bdbf-4ee2e053c2ae response_code = 200 uri = /vpc-routes
28482024-12-12T04:15:33.478ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
28492024-12-12T04:15:33.478ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 80af691a-30bb-4399-8524-a68071b516df
28502024-12-12T04:15:33.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36209 req_id = 0309c748-48d6-476c-a031-662574d3d3e9 response_code = 204 uri = /eip-gateways
28512024-12-12T04:15:33.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36209 req_id = 8f773d78-14f0-4a4e-bfdc-4c70af455ce7 response_code = 204 uri = /vpc-routes
28522024-12-12T04:15:33.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56417
28532024-12-12T04:15:33.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56417 req_id = 897915fb-b059-4daa-af43-eea5f48030f2 response_code = 200 uri = /v2p
28542024-12-12T04:15:34.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44588
28552024-12-12T04:15:34.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44588 req_id = c5dc3d98-10f4-4803-a647-946bdd8a218a response_code = 200 uri = /v2p
28562024-12-12T04:15:34.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46369
28572024-12-12T04:15:34.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46369 req_id = e80876fa-d373-4705-8d49-5bad8780da51 response_code = 200 uri = /vpc-routes
28582024-12-12T04:15:34.825ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
28592024-12-12T04:15:34.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46369 req_id = 3f4c1561-7f1f-4add-a4e5-3edc8d74948b response_code = 204 uri = /eip-gateways
28602024-12-12T04:15:34.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46369 req_id = e111af81-fc41-4787-8c96-946463ca4838 response_code = 204 uri = /vpc-routes
28612024-12-12T04:15:35.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37513
28622024-12-12T04:15:35.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37513 req_id = a320329d-8438-40b4-aa5b-6863049806b3 response_code = 200 uri = /vpc-routes
28632024-12-12T04:15:35.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 80af691a-30bb-4399-8524-a68071b516df values = ExternalIpGatewayMap { mappings: {} }
28642024-12-12T04:15:35.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37513 req_id = 590a9551-7934-4c27-bfc2-0621f691038a response_code = 204 uri = /eip-gateways
28652024-12-12T04:15:35.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37513 req_id = 7ca2dfa9-321b-4032-a642-84db7f3fba60 response_code = 204 uri = /vpc-routes
28662024-12-12T04:15:36.737ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44981
28672024-12-12T04:15:36.737ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44981 req_id = 063c8308-df5f-4c91-84dc-3280d4b5647f response_code = 200 uri = /baseboard