Max level shown:
1 [ Nov 21 19:29:40 Enabled. ]
2 [ Nov 21 19:29:40 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 21 19:29:40 Method "start" exited with status 0. ]
4 [ Nov 21 19:29:40 Rereading configuration. ]
5 [ Nov 21 19:29:40 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-21T19:29:40.921ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-21T19:29:40.921ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-21T19:29:40.973ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-21T19:29:40.973ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-21T19:29:41.087ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-21T19:29:41.095ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-21T19:29:41.104ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-21T19:29:41.704ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-21T19:29:41.843ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-21T19:29:41.843ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-21T19:29:41.843ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-21T19:29:41.843ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-21T19:29:41.844ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-11-21T19:29:41.844ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-11-21T19:29:41.847ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-21T19:29:41.847ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-21T19:29:41.847ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-21T19:29:41.847ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-21T19:29:41.847ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-21T19:29:41.847ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-21T19:29:41.847ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-21T19:29:41.847ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-21T19:29:41.847ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-21T19:29:41.859ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-21T19:29:41.859ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool)
322024-11-21T19:29:41.961ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal }
332024-11-21T19:29:42.449ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-21T19:29:42.449ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-21T19:29:42.449ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-21T19:29:42.449ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-21T19:29:42.449ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-21T19:29:42.449ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-21T19:29:42.449ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-21T19:29:42.457ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-21T19:29:42.458ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool)
422024-11-21T19:29:42.548ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal }
432024-11-21T19:29:43.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-21T19:29:43.026ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-21T19:29:43.026ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-21T19:29:43.026ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-21T19:29:43.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-21T19:29:43.026ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-21T19:29:43.026ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
522024-11-21T19:29:43.026ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-11-21T19:29:43.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-21T19:29:43.026ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-21T19:29:43.026ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-11-21T19:29:43.026ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-21T19:29:43.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-21T19:29:43.026ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-11-21T19:29:43.026ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-11-21T19:29:43.026ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-11-21T19:29:43.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-21T19:29:43.026ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-21T19:29:43.026ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
702024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
712024-11-21T19:29:43.026ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
722024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-11-21T19:29:43.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-21T19:29:43.026ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-21T19:29:43.026ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-21T19:29:43.026ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-21T19:29:43.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-21T19:29:43.026ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-11-21T19:29:43.026ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-11-21T19:29:43.026ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-21T19:29:43.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-21T19:29:43.026ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-21T19:29:43.026ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-21T19:29:43.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-11-21T19:29:43.026ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
902024-11-21T19:29:43.026ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
912024-11-21T19:29:43.026ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
922024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-11-21T19:29:43.026ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-11-21T19:29:43.026ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
962024-11-21T19:29:43.026ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972024-11-21T19:29:43.026ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
982024-11-21T19:29:43.026ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
992024-11-21T19:29:43.027ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002024-11-21T19:29:43.027ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1012024-11-21T19:29:43.027ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1022024-11-21T19:29:43.027ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1032024-11-21T19:29:43.027ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1042024-11-21T19:29:43.027ZINFOSledAgent (bootstore): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1052024-11-21T19:29:43.027ZINFOSledAgent (bootstore): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1062024-11-21T19:29:43.027ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-21T19:29:43.027ZINFOSledAgent (bootstore): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1082024-11-21T19:29:43.027ZINFOSledAgent (bootstore): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1092024-11-21T19:29:43.027ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-21T19:29:43.027ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-21T19:29:43.027ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-21T19:29:43.038ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:743
1132024-11-21T19:29:43.038ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
1142024-11-21T19:29:43.038ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1125, tv_nsec: 484176728 } time_to_next_cleanup = 599.999921339s
1152024-11-21T19:29:43.038ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-21T19:29:43.038ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/sled-agent-request.json file = common/src/ledger.rs:189
1172024-11-21T19:29:43.038ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/sled-agent-request.json file = common/src/ledger.rs:189
1182024-11-21T19:29:43.041ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-21T19:29:43.043ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-21T19:29:43.043ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-21T19:29:43.043ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-21T19:29:43.043ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-21T19:29:43.043ZINFOSledAgent (RSS): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1242024-11-21T19:29:43.043ZINFOSledAgent (RSS): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1252024-11-21T19:29:43.043ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-21T19:29:43.043ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-21T19:29:43.043ZINFOSledAgent (RSS): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/rss-sled-plan.json file = common/src/ledger.rs:189
1282024-11-21T19:29:43.043ZINFOSledAgent (RSS): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/rss-sled-plan.json file = common/src/ledger.rs:189
1292024-11-21T19:29:43.043ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-21T19:29:43.043ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-21T19:29:43.043ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-21T19:29:43.043ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-21T19:29:43.043ZINFOSledAgent (RSS): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1342024-11-21T19:29:43.044ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/rss-sled-plan.json"
1352024-11-21T19:29:43.044ZINFOSledAgent (RSS): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1362024-11-21T19:29:43.044ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/rss-sled-plan.json"
1372024-11-21T19:29:43.044ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 6f50eaaf-6509-4592-a570-21594f7b8789, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 203795ed-576b-40e4-bed8-7463e3f2162c (sled), rack_id: 6f50eaaf-6509-4592-a570-21594f7b8789, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1382024-11-21T19:29:43.044ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1392024-11-21T19:29:43.044ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1402024-11-21T19:29:43.044ZINFOSledAgent (bootstore): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1412024-11-21T19:29:43.044ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1422024-11-21T19:29:43.044ZINFOSledAgent (bootstore): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1432024-11-21T19:29:43.044ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1442024-11-21T19:29:43.044ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1452024-11-21T19:29:43.044ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 203795ed-576b-40e4-bed8-7463e3f2162c (sled), rack_id: 6f50eaaf-6509-4592-a570-21594f7b8789, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1462024-11-21T19:29:43.045ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4302
1472024-11-21T19:29:43.045ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4702
1482024-11-21T19:29:43.050ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1492024-11-21T19:29:43.056ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1502024-11-21T19:29:43.056ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1512024-11-21T19:29:43.060ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1522024-11-21T19:29:43.060ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1532024-11-21T19:29:43.060ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:39192
1542024-11-21T19:29:43.060ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 203795ed-576b-40e4-bed8-7463e3f2162c (sled), rack_id: 6f50eaaf-6509-4592-a570-21594f7b8789, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1552024-11-21T19:29:43.060ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1562024-11-21T19:29:43.060ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1572024-11-21T19:29:43.060ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1582024-11-21T19:29:43.060ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1592024-11-21T19:29:43.060ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1602024-11-21T19:29:43.061ZINFOSledAgent (StorageManager): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1612024-11-21T19:29:43.061ZINFOSledAgent (StorageManager): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1622024-11-21T19:29:43.061ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1632024-11-21T19:29:43.061ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1642024-11-21T19:29:43.061ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1652024-11-21T19:29:43.061ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1662024-11-21T19:29:43.061ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1672024-11-21T19:29:43.061ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1682024-11-21T19:29:43.076ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-21T19:29:43.098ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1702024-11-21T19:29:43.114ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1712024-11-21T19:29:43.123ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:407 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
1722024-11-21T19:29:43.123ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1732024-11-21T19:29:43.123ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:419 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
1742024-11-21T19:29:43.123ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1752024-11-21T19:29:43.126ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 92.265632ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a1c8faf4-4898-475b-8826-a23189864dd9", "content-length": "124", "date": "Thu, 21 Nov 2024 19:29:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a1c8faf4-4898-475b-8826-a23189864dd9" } file = clients/ddm-admin-client/src/lib.rs:177
1762024-11-21T19:29:43.137ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_996782d1-dad1-4047-aff6-e695ddfee4b7/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1772024-11-21T19:29:43.160ZINFOSledAgent: successfully created encrypted zvol: name="oxi_996782d1-dad1-4047-aff6-e695ddfee4b7/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-11-21T19:29:43.160ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_996782d1-dad1-4047-aff6-e695ddfee4b7/swap" file = sled-agent/src/swap_device.rs:96
1792024-11-21T19:29:43.165ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:434 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
1802024-11-21T19:29:43.165ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1812024-11-21T19:29:43.165ZINFOSledAgent (BackingFs): Ensuring dataset oxi_996782d1-dad1-4047-aff6-e695ddfee4b7/backing/fmd file = sled-agent/src/backing_fs.rs:138
1822024-11-21T19:29:43.219ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-11-21T19:29:43.219ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 128.001786ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b5a7bf9e-5332-4390-82b4-dd43eb27c659", "content-length": "124", "date": "Thu, 21 Nov 2024 19:29:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b5a7bf9e-5332-4390-82b4-dd43eb27c659" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-11-21T19:29:43.248ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1852024-11-21T19:29:43.349ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-11-21T19:29:43.349ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 131.922981ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c0424fbc-8bc6-40c0-9b84-75b67f288ddc", "content-length": "124", "date": "Thu, 21 Nov 2024 19:29:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c0424fbc-8bc6-40c0-9b84-75b67f288ddc" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-11-21T19:29:43.467ZINFOSledAgent (BackingFs): Mounting oxi_996782d1-dad1-4047-aff6-e695ddfee4b7/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1882024-11-21T19:29:43.480ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1892024-11-21T19:29:43.480ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1902024-11-21T19:29:43.480ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1912024-11-21T19:29:43.480ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1922024-11-21T19:29:43.483ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-21T19:29:43.483ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 180.146971ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0d5d34fc-5561-4ee0-a9a5-38dfbde4f0b4", "content-length": "124", "date": "Thu, 21 Nov 2024 19:29:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0d5d34fc-5561-4ee0-a9a5-38dfbde4f0b4" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-21T19:29:43.665ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-21T19:29:43.665ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 192.196518ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9028674f-167b-44ef-901e-7b685f05aa21", "content-length": "124", "date": "Thu, 21 Nov 2024 19:29:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9028674f-167b-44ef-901e-7b685f05aa21" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-21T19:29:43.858ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1972024-11-21T19:29:43.859ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 189.014295ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "83b2f0d9-cf06-4943-a5bb-cdbf5edf821c", "content-length": "124", "date": "Thu, 21 Nov 2024 19:29:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "83b2f0d9-cf06-4943-a5bb-cdbf5edf821c" } file = clients/ddm-admin-client/src/lib.rs:177
1982024-11-21T19:29:44.049ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1992024-11-21T19:29:44.050ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 379.128107ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "31f7c09d-055e-43e9-b1f3-0226a83403cb", "content-length": "124", "date": "Thu, 21 Nov 2024 19:29:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "31f7c09d-055e-43e9-b1f3-0226a83403cb" } file = clients/ddm-admin-client/src/lib.rs:177
2002024-11-21T19:29:44.214ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2012024-11-21T19:29:44.220ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:46831 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2022024-11-21T19:29:44.220ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2032024-11-21T19:29:44.220ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:46831 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 203795ed-576b-40e4-bed8-7463e3f2162c sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2042024-11-21T19:29:44.221ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 277.941203ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2052024-11-21T19:29:44.221ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2062024-11-21T19:29:44.221ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2072024-11-21T19:29:44.222ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:927 underlay_address = fd00:1122:3344:101::1
2082024-11-21T19:29:44.222ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2092024-11-21T19:29:44.430ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2102024-11-21T19:29:44.500ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 438.137038ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2112024-11-21T19:29:44.941ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.065219796s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2122024-11-21T19:29:46.008ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.016878286s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2132024-11-21T19:29:46.904ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2676
2142024-11-21T19:29:46.904ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2921
2152024-11-21T19:29:46.904ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2546
2162024-11-21T19:29:46.904ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2593
2172024-11-21T19:29:46.904ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3002
2182024-11-21T19:29:46.904ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3047
2192024-11-21T19:29:46.906ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2846
2202024-11-21T19:29:46.907ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2587
2212024-11-21T19:29:46.907ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='c05ae1ff-cffb-4ab3-9615-3762b6ee2d1a'/> <propval type="astring" name="rack_id" value='6f50eaaf-6509-4592-a570-21594f7b8789'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe22:2a7e'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='6f50eaaf-6509-4592-a570-21594f7b8789'/> <propval type="astring" name="sled_id" value='203795ed-576b-40e4-bed8-7463e3f2162c'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='203795ed-576b-40e4-bed8-7463e3f2162c'/> <propval type="astring" name="rack_uuid" value='6f50eaaf-6509-4592-a570-21594f7b8789'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='203795ed-576b-40e4-bed8-7463e3f2162c'/> <propval type="astring" name="rack_uuid" value='6f50eaaf-6509-4592-a570-21594f7b8789'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2222024-11-21T19:29:46.908ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2232024-11-21T19:29:47.027ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.160307684s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2242024-11-21T19:29:47.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 66.893936ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-21T19:29:47.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 149.69042ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-21T19:29:47.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 258.381437ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-21T19:29:47.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 454.678466ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-21T19:29:48.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.164532036s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-21T19:29:49.189ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.021906205s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2302024-11-21T19:29:49.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 678.908398ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2312024-11-21T19:29:50.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 852.108327ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2322024-11-21T19:29:51.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.208196506s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2332024-11-21T19:29:53.244ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/nexus.rs:527 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2342024-11-21T19:29:53.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2352024-11-21T19:29:53.281ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2362024-11-21T19:29:53.283ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2372024-11-21T19:29:53.283ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2382024-11-21T19:29:53.283ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2392024-11-21T19:29:53.283ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2402024-11-21T19:29:53.283ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/sled-agent-request.json"
2412024-11-21T19:29:53.283ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2422024-11-21T19:29:53.283ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/sled-agent-request.json"
2432024-11-21T19:29:53.283ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2442024-11-21T19:29:53.283ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2452024-11-21T19:29:53.283ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
2462024-11-21T19:29:53.283ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:39192
2472024-11-21T19:29:53.469ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2482024-11-21T19:29:53.469ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2492024-11-21T19:29:53.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-21T19:29:53.469ZINFOSledAgent (RSS): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2512024-11-21T19:29:53.469ZINFOSledAgent (RSS): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2522024-11-21T19:29:53.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2532024-11-21T19:29:53.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2542024-11-21T19:29:53.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-11-21T19:29:53.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-21T19:29:53.474ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4326 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2572024-11-21T19:29:53.474ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4342
2582024-11-21T19:29:53.474ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2592024-11-21T19:29:53.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54257
2602024-11-21T19:29:53.740ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2612024-11-21T19:29:53.740ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2622024-11-21T19:29:53.740ZINFOSledAgent (ServiceManager): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json file = common/src/ledger.rs:189
2632024-11-21T19:29:53.740ZINFOSledAgent (ServiceManager): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json file = common/src/ledger.rs:189
2642024-11-21T19:29:53.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54257 req_id = 311f3859-a629-4c15-8058-00cc41aecc29 response_code = 200 uri = /inventory
2652024-11-21T19:29:53.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57022
2662024-11-21T19:29:53.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57022 req_id = 17f21726-93e9-428d-8cc6-7251e1cf9808 response_code = 200 uri = /sled-role
2672024-11-21T19:29:53.773ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2682024-11-21T19:29:53.773ZINFOSledAgent (RSS): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2692024-11-21T19:29:53.773ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/rss-service-plan-v5.json"
2702024-11-21T19:29:53.773ZINFOSledAgent (RSS): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2712024-11-21T19:29:53.774ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/rss-service-plan-v5.json"
2722024-11-21T19:29:53.774ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2732024-11-21T19:29:53.804ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 97bc8336-c1bb-4190-8f44-6ef05511d085, pool_id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 47965307-fdda-44dc-a611-a5a7c3578232, pool_id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 34d95804-b45d-410f-bb16-8a26f49afa20, pool_id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ed27390b-3b15-427c-a4b3-7c8083f63de8, pool_id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f2f6a3e1-dd9c-4ce6-82c7-3bf155c60654, pool_id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 18fcb76d-90f3-4553-8f1f-534bc754da33, pool_id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: c336c55b-4384-4b13-97bb-0c94ae59eeb3, pool_id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: c9703468-9848-4447-aff7-61fa4ac70286, pool_id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 758debc9-3e16-49fa-b911-5f5dccf8a1a1, pool_id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2742024-11-21T19:29:53.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39114
2752024-11-21T19:29:53.804ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:883 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2762024-11-21T19:29:53.804ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 97bc8336-c1bb-4190-8f44-6ef05511d085, pool_id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 47965307-fdda-44dc-a611-a5a7c3578232, pool_id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 34d95804-b45d-410f-bb16-8a26f49afa20, pool_id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ed27390b-3b15-427c-a4b3-7c8083f63de8, pool_id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f2f6a3e1-dd9c-4ce6-82c7-3bf155c60654, pool_id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 18fcb76d-90f3-4553-8f1f-534bc754da33, pool_id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: c336c55b-4384-4b13-97bb-0c94ae59eeb3, pool_id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: c9703468-9848-4447-aff7-61fa4ac70286, pool_id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 758debc9-3e16-49fa-b911-5f5dccf8a1a1, pool_id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2772024-11-21T19:29:53.804ZINFOSledAgent (StorageManager): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2782024-11-21T19:29:53.804ZINFOSledAgent (StorageManager): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2792024-11-21T19:29:53.804ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1175 request = omicron_physical_disks_ensure
2802024-11-21T19:29:53.804ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2812024-11-21T19:29:53.804ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2822024-11-21T19:29:53.804ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832024-11-21T19:29:53.804ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2842024-11-21T19:29:53.986ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2852024-11-21T19:29:53.986ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool)
2862024-11-21T19:29:54.224ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2872024-11-21T19:29:54.224ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2882024-11-21T19:29:54.460ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2892024-11-21T19:29:54.927ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
2902024-11-21T19:29:54.961ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }
2912024-11-21T19:29:54.968ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2922024-11-21T19:29:54.968ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2932024-11-21T19:29:54.968ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2942024-11-21T19:29:54.968ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2952024-11-21T19:29:54.968ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2962024-11-21T19:29:54.968ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2972024-11-21T19:29:54.968ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2982024-11-21T19:29:55.002ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2992024-11-21T19:29:55.011ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone file = sled-storage/src/dataset.rs:303
3002024-11-21T19:29:55.178ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_11d53b36-56c4-493b-908d-a4b25d43b82e file = sled-storage/src/dataset.rs:389
3012024-11-21T19:29:55.186ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
3022024-11-21T19:29:55.186ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
3032024-11-21T19:29:55.186ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
3042024-11-21T19:29:55.186ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3052024-11-21T19:29:55.186ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
3062024-11-21T19:29:55.196ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3072024-11-21T19:29:55.196ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool)
3082024-11-21T19:29:55.286ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }
3092024-11-21T19:29:55.294ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3102024-11-21T19:29:55.294ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3112024-11-21T19:29:55.294ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3122024-11-21T19:29:55.294ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3132024-11-21T19:29:55.294ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3142024-11-21T19:29:55.294ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3152024-11-21T19:29:55.294ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3162024-11-21T19:29:55.325ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3172024-11-21T19:29:55.332ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone file = sled-storage/src/dataset.rs:303
3182024-11-21T19:29:55.463ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
3192024-11-21T19:29:55.506ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789 file = sled-storage/src/dataset.rs:389
3202024-11-21T19:29:55.515ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3212024-11-21T19:29:55.515ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3222024-11-21T19:29:55.515ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3232024-11-21T19:29:55.515ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3242024-11-21T19:29:55.515ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3252024-11-21T19:29:55.525ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3262024-11-21T19:29:55.525ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool)
3272024-11-21T19:29:55.620ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }
3282024-11-21T19:29:55.628ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3292024-11-21T19:29:55.628ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3302024-11-21T19:29:55.628ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3312024-11-21T19:29:55.628ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3322024-11-21T19:29:55.628ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3332024-11-21T19:29:55.628ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3342024-11-21T19:29:55.628ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3352024-11-21T19:29:55.665ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3362024-11-21T19:29:55.672ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone file = sled-storage/src/dataset.rs:303
3372024-11-21T19:29:55.843ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_784212b9-62b7-432d-b0d7-e4600fa06921 file = sled-storage/src/dataset.rs:389
3382024-11-21T19:29:55.851ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3392024-11-21T19:29:55.851ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3402024-11-21T19:29:55.851ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3412024-11-21T19:29:55.851ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3422024-11-21T19:29:55.851ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3432024-11-21T19:29:55.861ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3442024-11-21T19:29:55.861ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool)
3452024-11-21T19:29:55.956ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }
3462024-11-21T19:29:55.965ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3472024-11-21T19:29:55.965ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3482024-11-21T19:29:55.965ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3492024-11-21T19:29:55.965ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3502024-11-21T19:29:55.965ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3512024-11-21T19:29:55.965ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3522024-11-21T19:29:55.965ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3532024-11-21T19:29:56.001ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3542024-11-21T19:29:56.008ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_21742b4e-23b7-43df-8530-fcf02dea3824/crypt/zone file = sled-storage/src/dataset.rs:303
3552024-11-21T19:29:56.180ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_21742b4e-23b7-43df-8530-fcf02dea3824 file = sled-storage/src/dataset.rs:389
3562024-11-21T19:29:56.188ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3572024-11-21T19:29:56.188ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3582024-11-21T19:29:56.188ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3592024-11-21T19:29:56.188ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3602024-11-21T19:29:56.188ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3612024-11-21T19:29:56.199ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3622024-11-21T19:29:56.199ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool)
3632024-11-21T19:29:56.296ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }
3642024-11-21T19:29:56.304ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3652024-11-21T19:29:56.304ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3662024-11-21T19:29:56.304ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3672024-11-21T19:29:56.304ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3682024-11-21T19:29:56.304ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3692024-11-21T19:29:56.304ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3702024-11-21T19:29:56.305ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3712024-11-21T19:29:56.339ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3722024-11-21T19:29:56.348ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/zone file = sled-storage/src/dataset.rs:303
3732024-11-21T19:29:56.466ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
3742024-11-21T19:29:56.523ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0 file = sled-storage/src/dataset.rs:389
3752024-11-21T19:29:56.530ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3762024-11-21T19:29:56.530ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3772024-11-21T19:29:56.530ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3782024-11-21T19:29:56.530ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3792024-11-21T19:29:56.530ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3802024-11-21T19:29:56.540ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3812024-11-21T19:29:56.541ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 03f27c6c-e171-4450-8876-58f440dc9097 (zpool)
3822024-11-21T19:29:56.634ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }
3832024-11-21T19:29:56.642ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3842024-11-21T19:29:56.642ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3852024-11-21T19:29:56.642ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3862024-11-21T19:29:56.642ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3872024-11-21T19:29:56.642ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3882024-11-21T19:29:56.642ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3892024-11-21T19:29:56.642ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3902024-11-21T19:29:56.679ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3912024-11-21T19:29:56.689ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_03f27c6c-e171-4450-8876-58f440dc9097/crypt/zone file = sled-storage/src/dataset.rs:303
3922024-11-21T19:29:56.871ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_03f27c6c-e171-4450-8876-58f440dc9097 file = sled-storage/src/dataset.rs:389
3932024-11-21T19:29:56.880ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3942024-11-21T19:29:56.880ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3952024-11-21T19:29:56.880ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3962024-11-21T19:29:56.880ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3972024-11-21T19:29:56.880ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3982024-11-21T19:29:56.891ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3992024-11-21T19:29:56.891ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool)
4002024-11-21T19:29:56.992ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }
4012024-11-21T19:29:57.000ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
4022024-11-21T19:29:57.000ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
4032024-11-21T19:29:57.000ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
4042024-11-21T19:29:57.000ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
4052024-11-21T19:29:57.000ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4062024-11-21T19:29:57.000ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4072024-11-21T19:29:57.000ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4082024-11-21T19:29:57.038ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4092024-11-21T19:29:57.047ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f/crypt/zone file = sled-storage/src/dataset.rs:303
4102024-11-21T19:29:57.214ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.047167063s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4112024-11-21T19:29:57.223ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f file = sled-storage/src/dataset.rs:389
4122024-11-21T19:29:57.231ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4132024-11-21T19:29:57.232ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4142024-11-21T19:29:57.232ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4152024-11-21T19:29:57.232ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4162024-11-21T19:29:57.232ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4172024-11-21T19:29:57.241ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4182024-11-21T19:29:57.241ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 695b40ec-ab62-486b-99a5-161c372e3934 (zpool)
4192024-11-21T19:29:57.338ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }
4202024-11-21T19:29:57.346ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4212024-11-21T19:29:57.346ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4222024-11-21T19:29:57.346ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4232024-11-21T19:29:57.346ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4242024-11-21T19:29:57.346ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4252024-11-21T19:29:57.346ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4262024-11-21T19:29:57.346ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4272024-11-21T19:29:57.380ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4282024-11-21T19:29:57.388ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_695b40ec-ab62-486b-99a5-161c372e3934/crypt/zone file = sled-storage/src/dataset.rs:303
4292024-11-21T19:29:57.468ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4302024-11-21T19:29:57.557ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_695b40ec-ab62-486b-99a5-161c372e3934 file = sled-storage/src/dataset.rs:389
4312024-11-21T19:29:57.566ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4322024-11-21T19:29:57.566ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4332024-11-21T19:29:57.566ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4342024-11-21T19:29:57.566ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4352024-11-21T19:29:57.566ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4362024-11-21T19:29:57.575ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4372024-11-21T19:29:57.576ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool)
4382024-11-21T19:29:57.676ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }
4392024-11-21T19:29:57.685ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4402024-11-21T19:29:57.685ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4412024-11-21T19:29:57.685ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4422024-11-21T19:29:57.685ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4432024-11-21T19:29:57.685ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4442024-11-21T19:29:57.685ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4452024-11-21T19:29:57.685ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4462024-11-21T19:29:57.720ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4472024-11-21T19:29:57.729ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b36cfd4c-887e-4515-9f44-b45436c8de30/crypt/zone file = sled-storage/src/dataset.rs:303
4482024-11-21T19:29:57.902ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b36cfd4c-887e-4515-9f44-b45436c8de30 file = sled-storage/src/dataset.rs:389
4492024-11-21T19:29:57.910ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4502024-11-21T19:29:57.910ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4512024-11-21T19:29:57.910ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4522024-11-21T19:29:57.911ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 996782d1-dad1-4047-aff6-e695ddfee4b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 20e2b049-cfc5-4dbe-a0ef-d3766051460d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4532024-11-21T19:29:57.911ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4542024-11-21T19:29:57.911ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4552024-11-21T19:29:57.911ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4562024-11-21T19:29:57.911ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4572024-11-21T19:29:57.911ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4582024-11-21T19:29:57.911ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:887 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4592024-11-21T19:29:57.911ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4602024-11-21T19:29:57.911ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:913 generation = Generation(1) sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4612024-11-21T19:29:57.911ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:918 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4622024-11-21T19:29:57.911ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:923 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4632024-11-21T19:29:57.911ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4642024-11-21T19:29:57.911ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:929 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4652024-11-21T19:29:57.911ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4662024-11-21T19:29:57.911ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:934 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4672024-11-21T19:29:57.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4107319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39114 req_id = f610ebed-363f-4ebc-9a8b-fe79b4e15232 response_code = 200 uri = /omicron-physical-disks
4682024-11-21T19:29:57.943ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {03edf335-4ffa-4efa-a6b3-2b15bf239502 (dataset): DatasetConfig { id: 03edf335-4ffa-4efa-a6b3-2b15bf239502 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05457679-274a-434b-9ed4-3c0fc7907a2f (dataset): DatasetConfig { id: 05457679-274a-434b-9ed4-3c0fc7907a2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f3e1ba3-2820-44e3-904f-8a15a1af35b5 (dataset): DatasetConfig { id: 0f3e1ba3-2820-44e3-904f-8a15a1af35b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19ad8877-0cd8-430f-93d0-a2fe4b019f6b (dataset): DatasetConfig { id: 19ad8877-0cd8-430f-93d0-a2fe4b019f6b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19f0a8f7-b7a3-4d74-92f0-f74df9a64beb (dataset): DatasetConfig { id: 19f0a8f7-b7a3-4d74-92f0-f74df9a64beb (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b198539-4ff5-4f12-b5ae-b3c93649cd6d (dataset): DatasetConfig { id: 1b198539-4ff5-4f12-b5ae-b3c93649cd6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22d46aef-1b61-47c1-9beb-5a62ac1a43f9 (dataset): DatasetConfig { id: 22d46aef-1b61-47c1-9beb-5a62ac1a43f9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 236fdd07-cd10-49bf-b6f2-58198a053d10 (dataset): DatasetConfig { id: 236fdd07-cd10-49bf-b6f2-58198a053d10 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 295375ef-ce2c-444a-bfe2-4bde9d4cda58 (dataset): DatasetConfig { id: 295375ef-ce2c-444a-bfe2-4bde9d4cda58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ccf87c9-24cf-4dd8-929b-3d8730771fb9 (dataset): DatasetConfig { id: 2ccf87c9-24cf-4dd8-929b-3d8730771fb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d45f369-1fd0-49ab-9a17-63dac8e7b06f (dataset): DatasetConfig { id: 2d45f369-1fd0-49ab-9a17-63dac8e7b06f (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2df3ed63-7409-48a5-944b-1bd8666ac753 (dataset): DatasetConfig { id: 2df3ed63-7409-48a5-944b-1bd8666ac753 (dataset), name: DatasetName { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 312ee046-21f2-4e53-8941-56b2fb40de04 (dataset): DatasetConfig { id: 312ee046-21f2-4e53-8941-56b2fb40de04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 336cabda-baae-4d4c-9a30-af4e8fc93ae8 (dataset): DatasetConfig { id: 336cabda-baae-4d4c-9a30-af4e8fc93ae8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3576f103-bba4-4034-bdcd-edf468a89141 (dataset): DatasetConfig { id: 3576f103-bba4-4034-bdcd-edf468a89141 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b99859f-c8c3-4cc0-b7ef-4b65385a1d11 (dataset): DatasetConfig { id: 3b99859f-c8c3-4cc0-b7ef-4b65385a1d11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4055c44f-2184-4a17-92e5-04f20536dfa3 (dataset): DatasetConfig { id: 4055c44f-2184-4a17-92e5-04f20536dfa3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45f63612-2006-4def-83fe-b41b32509f49 (dataset): DatasetConfig { id: 45f63612-2006-4def-83fe-b41b32509f49 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46c4ddf9-8fcb-40a5-95f0-29d9374a5b56 (dataset): DatasetConfig { id: 46c4ddf9-8fcb-40a5-95f0-29d9374a5b56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a1f80cc-a8b4-4ef6-bfa6-17b4717d87bc (dataset): DatasetConfig { id: 4a1f80cc-a8b4-4ef6-bfa6-17b4717d87bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e0eea48-efbc-4dda-b166-015961186363 (dataset): DatasetConfig { id: 4e0eea48-efbc-4dda-b166-015961186363 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e4543ea-5c1e-4c5a-a828-e51fd398aa26 (dataset): DatasetConfig { id: 4e4543ea-5c1e-4c5a-a828-e51fd398aa26 (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4eb3b93f-8722-47ee-b993-10e6065fef70 (dataset): DatasetConfig { id: 4eb3b93f-8722-47ee-b993-10e6065fef70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51b2f07d-6d34-45f8-b286-009e80ac96ec (dataset): DatasetConfig { id: 51b2f07d-6d34-45f8-b286-009e80ac96ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5460ae8e-cd99-4c92-b137-5797a76717e6 (dataset): DatasetConfig { id: 5460ae8e-cd99-4c92-b137-5797a76717e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55eaee5e-84e4-4889-b234-37f286c93c26 (dataset): DatasetConfig { id: 55eaee5e-84e4-4889-b234-37f286c93c26 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57070133-a43f-44cc-8aa5-a60ffee76a7b (dataset): DatasetConfig { id: 57070133-a43f-44cc-8aa5-a60ffee76a7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5f844438-d007-4fdc-a321-42e34dc62063 (dataset): DatasetConfig { id: 5f844438-d007-4fdc-a321-42e34dc62063 (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61d03f53-77d9-4561-9736-0e2fc1a6e0a9 (dataset): DatasetConfig { id: 61d03f53-77d9-4561-9736-0e2fc1a6e0a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 654f8d55-de39-4d0e-a5a0-1be70de2c1ac (dataset): DatasetConfig { id: 654f8d55-de39-4d0e-a5a0-1be70de2c1ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 68bd8889-9970-4c99-a065-193ac7f97fc6 (dataset): DatasetConfig { id: 68bd8889-9970-4c99-a065-193ac7f97fc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ef7e625-0b57-418c-88b9-c3220a68fe90 (dataset): DatasetConfig { id: 6ef7e625-0b57-418c-88b9-c3220a68fe90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71fca6fd-25c0-4d68-8c3a-b783d0922a84 (dataset): DatasetConfig { id: 71fca6fd-25c0-4d68-8c3a-b783d0922a84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 770c9d78-7a5f-4d5d-a4ee-3e8e9f92669c (dataset): DatasetConfig { id: 770c9d78-7a5f-4d5d-a4ee-3e8e9f92669c (dataset), name: DatasetName { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c437147-2b69-4049-b2bd-8a3e81a1f77a (dataset): DatasetConfig { id: 7c437147-2b69-4049-b2bd-8a3e81a1f77a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7fe61d08-0acb-49e3-aa42-c3bfd08e95ad (dataset): DatasetConfig { id: 7fe61d08-0acb-49e3-aa42-c3bfd08e95ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8bd4654e-b6d1-4a19-92b3-746058f05cd9 (dataset): DatasetConfig { id: 8bd4654e-b6d1-4a19-92b3-746058f05cd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91b0ed99-c23d-4c10-abbc-b053f40c2ef9 (dataset): DatasetConfig { id: 91b0ed99-c23d-4c10-abbc-b053f40c2ef9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 92cb3a87-aa7a-44d9-bb59-49a8151cfe51 (dataset): DatasetConfig { id: 92cb3a87-aa7a-44d9-bb59-49a8151cfe51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9557b60a-e66f-492b-9831-7790350f0598 (dataset): DatasetConfig { id: 9557b60a-e66f-492b-9831-7790350f0598 (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c16890-66c3-40d2-a7df-fdc8e8e10aff (dataset): DatasetConfig { id: 95c16890-66c3-40d2-a7df-fdc8e8e10aff (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a779a1a-61b8-4778-8380-f8dc61ba0dcf (dataset): DatasetConfig { id: 9a779a1a-61b8-4778-8380-f8dc61ba0dcf (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9acd37ed-0eca-488e-9a57-a4bb97e4f792 (dataset): DatasetConfig { id: 9acd37ed-0eca-488e-9a57-a4bb97e4f792 (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b9ffa89-8e36-40ea-a10a-f8357fa857a7 (dataset): DatasetConfig { id: 9b9ffa89-8e36-40ea-a10a-f8357fa857a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c540566-3c30-47cb-bfb4-5a36d42029c6 (dataset): DatasetConfig { id: 9c540566-3c30-47cb-bfb4-5a36d42029c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9dee5274-ce10-4688-bebd-c35babc558fe (dataset): DatasetConfig { id: 9dee5274-ce10-4688-bebd-c35babc558fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a195a49b-b28a-4807-9c88-bf9a13817d9c (dataset): DatasetConfig { id: a195a49b-b28a-4807-9c88-bf9a13817d9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a65dfb33-a9dd-4887-97fd-7b5444012de3 (dataset): DatasetConfig { id: a65dfb33-a9dd-4887-97fd-7b5444012de3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a8c701a3-ce41-43dd-8cec-bffb03fb0059 (dataset): DatasetConfig { id: a8c701a3-ce41-43dd-8cec-bffb03fb0059 (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b5f9f378-083d-43d2-a859-199ab06f764c (dataset): DatasetConfig { id: b5f9f378-083d-43d2-a859-199ab06f764c (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b835094c-3920-4062-bd83-47f90bc2deed (dataset): DatasetConfig { id: b835094c-3920-4062-bd83-47f90bc2deed (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd2dd562-dac9-4660-9174-2fe45746163d (dataset): DatasetConfig { id: bd2dd562-dac9-4660-9174-2fe45746163d (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd7ae215-f651-4c26-8f56-ae84ece22eb0 (dataset): DatasetConfig { id: bd7ae215-f651-4c26-8f56-ae84ece22eb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c09b5349-02ca-463b-897d-169374c2934d (dataset): DatasetConfig { id: c09b5349-02ca-463b-897d-169374c2934d (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5177758-02e4-4421-b268-d4b589927570 (dataset): DatasetConfig { id: c5177758-02e4-4421-b268-d4b589927570 (dataset), name: DatasetName { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5e5a529-3e0c-443c-8fe7-03101056b8d3 (dataset): DatasetConfig { id: c5e5a529-3e0c-443c-8fe7-03101056b8d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1631636-ab9e-48e2-819f-d11c2835d0ef (dataset): DatasetConfig { id: d1631636-ab9e-48e2-819f-d11c2835d0ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d253912b-a096-4004-a62d-c57541e0ce38 (dataset): DatasetConfig { id: d253912b-a096-4004-a62d-c57541e0ce38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e110454f-5e39-484b-be3f-d6470ce21234 (dataset): DatasetConfig { id: e110454f-5e39-484b-be3f-d6470ce21234 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e417883a-2ae3-4432-8acd-6857aad2683f (dataset): DatasetConfig { id: e417883a-2ae3-4432-8acd-6857aad2683f (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e9998a4d-5121-4b6a-8c96-0fbc444d383f (dataset): DatasetConfig { id: e9998a4d-5121-4b6a-8c96-0fbc444d383f (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb028e85-f616-442c-9f2f-e663af2edef3 (dataset): DatasetConfig { id: eb028e85-f616-442c-9f2f-e663af2edef3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4911ad2-f745-4c73-8d9f-443016c29f38 (dataset): DatasetConfig { id: f4911ad2-f745-4c73-8d9f-443016c29f38 (dataset), name: DatasetName { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5790d30-5688-4da6-a240-a861be849e89 (dataset): DatasetConfig { id: f5790d30-5688-4da6-a240-a861be849e89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa531235-fd57-4c1a-829c-ef60be217027 (dataset): DatasetConfig { id: fa531235-fd57-4c1a-829c-ef60be217027 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ffb8b3cf-68db-448c-9b7e-8a565e7e44b3 (dataset): DatasetConfig { id: ffb8b3cf-68db-448c-9b7e-8a565e7e44b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4692024-11-21T19:29:57.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64049
4702024-11-21T19:29:57.943ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:849 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4712024-11-21T19:29:57.943ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {03edf335-4ffa-4efa-a6b3-2b15bf239502 (dataset): DatasetConfig { id: 03edf335-4ffa-4efa-a6b3-2b15bf239502 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05457679-274a-434b-9ed4-3c0fc7907a2f (dataset): DatasetConfig { id: 05457679-274a-434b-9ed4-3c0fc7907a2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f3e1ba3-2820-44e3-904f-8a15a1af35b5 (dataset): DatasetConfig { id: 0f3e1ba3-2820-44e3-904f-8a15a1af35b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19ad8877-0cd8-430f-93d0-a2fe4b019f6b (dataset): DatasetConfig { id: 19ad8877-0cd8-430f-93d0-a2fe4b019f6b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19f0a8f7-b7a3-4d74-92f0-f74df9a64beb (dataset): DatasetConfig { id: 19f0a8f7-b7a3-4d74-92f0-f74df9a64beb (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b198539-4ff5-4f12-b5ae-b3c93649cd6d (dataset): DatasetConfig { id: 1b198539-4ff5-4f12-b5ae-b3c93649cd6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22d46aef-1b61-47c1-9beb-5a62ac1a43f9 (dataset): DatasetConfig { id: 22d46aef-1b61-47c1-9beb-5a62ac1a43f9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 236fdd07-cd10-49bf-b6f2-58198a053d10 (dataset): DatasetConfig { id: 236fdd07-cd10-49bf-b6f2-58198a053d10 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 295375ef-ce2c-444a-bfe2-4bde9d4cda58 (dataset): DatasetConfig { id: 295375ef-ce2c-444a-bfe2-4bde9d4cda58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ccf87c9-24cf-4dd8-929b-3d8730771fb9 (dataset): DatasetConfig { id: 2ccf87c9-24cf-4dd8-929b-3d8730771fb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d45f369-1fd0-49ab-9a17-63dac8e7b06f (dataset): DatasetConfig { id: 2d45f369-1fd0-49ab-9a17-63dac8e7b06f (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2df3ed63-7409-48a5-944b-1bd8666ac753 (dataset): DatasetConfig { id: 2df3ed63-7409-48a5-944b-1bd8666ac753 (dataset), name: DatasetName { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 312ee046-21f2-4e53-8941-56b2fb40de04 (dataset): DatasetConfig { id: 312ee046-21f2-4e53-8941-56b2fb40de04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 336cabda-baae-4d4c-9a30-af4e8fc93ae8 (dataset): DatasetConfig { id: 336cabda-baae-4d4c-9a30-af4e8fc93ae8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3576f103-bba4-4034-bdcd-edf468a89141 (dataset): DatasetConfig { id: 3576f103-bba4-4034-bdcd-edf468a89141 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b99859f-c8c3-4cc0-b7ef-4b65385a1d11 (dataset): DatasetConfig { id: 3b99859f-c8c3-4cc0-b7ef-4b65385a1d11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4055c44f-2184-4a17-92e5-04f20536dfa3 (dataset): DatasetConfig { id: 4055c44f-2184-4a17-92e5-04f20536dfa3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45f63612-2006-4def-83fe-b41b32509f49 (dataset): DatasetConfig { id: 45f63612-2006-4def-83fe-b41b32509f49 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46c4ddf9-8fcb-40a5-95f0-29d9374a5b56 (dataset): DatasetConfig { id: 46c4ddf9-8fcb-40a5-95f0-29d9374a5b56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a1f80cc-a8b4-4ef6-bfa6-17b4717d87bc (dataset): DatasetConfig { id: 4a1f80cc-a8b4-4ef6-bfa6-17b4717d87bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e0eea48-efbc-4dda-b166-015961186363 (dataset): DatasetConfig { id: 4e0eea48-efbc-4dda-b166-015961186363 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e4543ea-5c1e-4c5a-a828-e51fd398aa26 (dataset): DatasetConfig { id: 4e4543ea-5c1e-4c5a-a828-e51fd398aa26 (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4eb3b93f-8722-47ee-b993-10e6065fef70 (dataset): DatasetConfig { id: 4eb3b93f-8722-47ee-b993-10e6065fef70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51b2f07d-6d34-45f8-b286-009e80ac96ec (dataset): DatasetConfig { id: 51b2f07d-6d34-45f8-b286-009e80ac96ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5460ae8e-cd99-4c92-b137-5797a76717e6 (dataset): DatasetConfig { id: 5460ae8e-cd99-4c92-b137-5797a76717e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55eaee5e-84e4-4889-b234-37f286c93c26 (dataset): DatasetConfig { id: 55eaee5e-84e4-4889-b234-37f286c93c26 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57070133-a43f-44cc-8aa5-a60ffee76a7b (dataset): DatasetConfig { id: 57070133-a43f-44cc-8aa5-a60ffee76a7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5f844438-d007-4fdc-a321-42e34dc62063 (dataset): DatasetConfig { id: 5f844438-d007-4fdc-a321-42e34dc62063 (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61d03f53-77d9-4561-9736-0e2fc1a6e0a9 (dataset): DatasetConfig { id: 61d03f53-77d9-4561-9736-0e2fc1a6e0a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 654f8d55-de39-4d0e-a5a0-1be70de2c1ac (dataset): DatasetConfig { id: 654f8d55-de39-4d0e-a5a0-1be70de2c1ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 68bd8889-9970-4c99-a065-193ac7f97fc6 (dataset): DatasetConfig { id: 68bd8889-9970-4c99-a065-193ac7f97fc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ef7e625-0b57-418c-88b9-c3220a68fe90 (dataset): DatasetConfig { id: 6ef7e625-0b57-418c-88b9-c3220a68fe90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71fca6fd-25c0-4d68-8c3a-b783d0922a84 (dataset): DatasetConfig { id: 71fca6fd-25c0-4d68-8c3a-b783d0922a84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 770c9d78-7a5f-4d5d-a4ee-3e8e9f92669c (dataset): DatasetConfig { id: 770c9d78-7a5f-4d5d-a4ee-3e8e9f92669c (dataset), name: DatasetName { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c437147-2b69-4049-b2bd-8a3e81a1f77a (dataset): DatasetConfig { id: 7c437147-2b69-4049-b2bd-8a3e81a1f77a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7fe61d08-0acb-49e3-aa42-c3bfd08e95ad (dataset): DatasetConfig { id: 7fe61d08-0acb-49e3-aa42-c3bfd08e95ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8bd4654e-b6d1-4a19-92b3-746058f05cd9 (dataset): DatasetConfig { id: 8bd4654e-b6d1-4a19-92b3-746058f05cd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91b0ed99-c23d-4c10-abbc-b053f40c2ef9 (dataset): DatasetConfig { id: 91b0ed99-c23d-4c10-abbc-b053f40c2ef9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 92cb3a87-aa7a-44d9-bb59-49a8151cfe51 (dataset): DatasetConfig { id: 92cb3a87-aa7a-44d9-bb59-49a8151cfe51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9557b60a-e66f-492b-9831-7790350f0598 (dataset): DatasetConfig { id: 9557b60a-e66f-492b-9831-7790350f0598 (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c16890-66c3-40d2-a7df-fdc8e8e10aff (dataset): DatasetConfig { id: 95c16890-66c3-40d2-a7df-fdc8e8e10aff (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a779a1a-61b8-4778-8380-f8dc61ba0dcf (dataset): DatasetConfig { id: 9a779a1a-61b8-4778-8380-f8dc61ba0dcf (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9acd37ed-0eca-488e-9a57-a4bb97e4f792 (dataset): DatasetConfig { id: 9acd37ed-0eca-488e-9a57-a4bb97e4f792 (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b9ffa89-8e36-40ea-a10a-f8357fa857a7 (dataset): DatasetConfig { id: 9b9ffa89-8e36-40ea-a10a-f8357fa857a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c540566-3c30-47cb-bfb4-5a36d42029c6 (dataset): DatasetConfig { id: 9c540566-3c30-47cb-bfb4-5a36d42029c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9dee5274-ce10-4688-bebd-c35babc558fe (dataset): DatasetConfig { id: 9dee5274-ce10-4688-bebd-c35babc558fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a195a49b-b28a-4807-9c88-bf9a13817d9c (dataset): DatasetConfig { id: a195a49b-b28a-4807-9c88-bf9a13817d9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a65dfb33-a9dd-4887-97fd-7b5444012de3 (dataset): DatasetConfig { id: a65dfb33-a9dd-4887-97fd-7b5444012de3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a8c701a3-ce41-43dd-8cec-bffb03fb0059 (dataset): DatasetConfig { id: a8c701a3-ce41-43dd-8cec-bffb03fb0059 (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b5f9f378-083d-43d2-a859-199ab06f764c (dataset): DatasetConfig { id: b5f9f378-083d-43d2-a859-199ab06f764c (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b835094c-3920-4062-bd83-47f90bc2deed (dataset): DatasetConfig { id: b835094c-3920-4062-bd83-47f90bc2deed (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd2dd562-dac9-4660-9174-2fe45746163d (dataset): DatasetConfig { id: bd2dd562-dac9-4660-9174-2fe45746163d (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd7ae215-f651-4c26-8f56-ae84ece22eb0 (dataset): DatasetConfig { id: bd7ae215-f651-4c26-8f56-ae84ece22eb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c09b5349-02ca-463b-897d-169374c2934d (dataset): DatasetConfig { id: c09b5349-02ca-463b-897d-169374c2934d (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5177758-02e4-4421-b268-d4b589927570 (dataset): DatasetConfig { id: c5177758-02e4-4421-b268-d4b589927570 (dataset), name: DatasetName { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5e5a529-3e0c-443c-8fe7-03101056b8d3 (dataset): DatasetConfig { id: c5e5a529-3e0c-443c-8fe7-03101056b8d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1631636-ab9e-48e2-819f-d11c2835d0ef (dataset): DatasetConfig { id: d1631636-ab9e-48e2-819f-d11c2835d0ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d253912b-a096-4004-a62d-c57541e0ce38 (dataset): DatasetConfig { id: d253912b-a096-4004-a62d-c57541e0ce38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e110454f-5e39-484b-be3f-d6470ce21234 (dataset): DatasetConfig { id: e110454f-5e39-484b-be3f-d6470ce21234 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e417883a-2ae3-4432-8acd-6857aad2683f (dataset): DatasetConfig { id: e417883a-2ae3-4432-8acd-6857aad2683f (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e9998a4d-5121-4b6a-8c96-0fbc444d383f (dataset): DatasetConfig { id: e9998a4d-5121-4b6a-8c96-0fbc444d383f (dataset), name: DatasetName { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb028e85-f616-442c-9f2f-e663af2edef3 (dataset): DatasetConfig { id: eb028e85-f616-442c-9f2f-e663af2edef3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4911ad2-f745-4c73-8d9f-443016c29f38 (dataset): DatasetConfig { id: f4911ad2-f745-4c73-8d9f-443016c29f38 (dataset), name: DatasetName { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5790d30-5688-4da6-a240-a861be849e89 (dataset): DatasetConfig { id: f5790d30-5688-4da6-a240-a861be849e89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa531235-fd57-4c1a-829c-ef60be217027 (dataset): DatasetConfig { id: fa531235-fd57-4c1a-829c-ef60be217027 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ffb8b3cf-68db-448c-9b7e-8a565e7e44b3 (dataset): DatasetConfig { id: ffb8b3cf-68db-448c-9b7e-8a565e7e44b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4722024-11-21T19:29:57.943ZINFOSledAgent (StorageManager): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4732024-11-21T19:29:57.943ZINFOSledAgent (StorageManager): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4742024-11-21T19:29:57.943ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:906 request = datasets_ensure
4752024-11-21T19:29:57.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4762024-11-21T19:29:57.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/03f27c6c-e171-4450-8876-58f440dc9097/crypt/zone"), full_name: "oxp_03f27c6c-e171-4450-8876-58f440dc9097/crypt/zone" } file = sled-storage/src/manager.rs:1338
4772024-11-21T19:29:58.011ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4782024-11-21T19:29:58.011ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone/oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone/oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839" } file = sled-storage/src/manager.rs:1338
4792024-11-21T19:29:58.108ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4802024-11-21T19:29:58.108ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_21742b4e-23b7-43df-8530-fcf02dea3824/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
4812024-11-21T19:29:58.197ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4822024-11-21T19:29:58.197ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a7d01cd-9218-405e-81a7-0632ac6eff3f/crypt/zone"), full_name: "oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f/crypt/zone" } file = sled-storage/src/manager.rs:1338
4832024-11-21T19:29:58.264ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4842024-11-21T19:29:58.264ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0/crucible" } file = sled-storage/src/manager.rs:1338
4852024-11-21T19:29:58.352ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4862024-11-21T19:29:58.352ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone" } file = sled-storage/src/manager.rs:1338
4872024-11-21T19:29:58.420ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4882024-11-21T19:29:58.420ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
4892024-11-21T19:29:58.471ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
4902024-11-21T19:29:58.507ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4912024-11-21T19:29:58.507ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d" } file = sled-storage/src/manager.rs:1338
4922024-11-21T19:29:58.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4932024-11-21T19:29:58.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
4942024-11-21T19:29:58.691ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4952024-11-21T19:29:58.692ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
4962024-11-21T19:29:58.794ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4972024-11-21T19:29:58.794ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/695b40ec-ab62-486b-99a5-161c372e3934/crypt/zone/oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0"), full_name: "oxp_695b40ec-ab62-486b-99a5-161c372e3934/crypt/zone/oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0" } file = sled-storage/src/manager.rs:1338
4982024-11-21T19:29:58.892ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4992024-11-21T19:29:58.892ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b36cfd4c-887e-4515-9f44-b45436c8de30/crypt/zone"), full_name: "oxp_b36cfd4c-887e-4515-9f44-b45436c8de30/crypt/zone" } file = sled-storage/src/manager.rs:1338
5002024-11-21T19:29:58.959ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5012024-11-21T19:29:58.959ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone/oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d"), full_name: "oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone/oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d" } file = sled-storage/src/manager.rs:1338
5022024-11-21T19:29:59.059ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5032024-11-21T19:29:59.059ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone/oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone/oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d" } file = sled-storage/src/manager.rs:1338
5042024-11-21T19:29:59.159ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5052024-11-21T19:29:59.159ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6" } file = sled-storage/src/manager.rs:1338
5062024-11-21T19:29:59.256ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5072024-11-21T19:29:59.256ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5082024-11-21T19:29:59.343ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5092024-11-21T19:29:59.343ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a7d01cd-9218-405e-81a7-0632ac6eff3f/crypt/zone/oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb"), full_name: "oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f/crypt/zone/oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb" } file = sled-storage/src/manager.rs:1338
5102024-11-21T19:29:59.438ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5112024-11-21T19:29:59.438ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone/oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone/oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c" } file = sled-storage/src/manager.rs:1338
5122024-11-21T19:29:59.472ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
5132024-11-21T19:29:59.536ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5142024-11-21T19:29:59.536ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/zone/oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e"), full_name: "oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/zone/oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e" } file = sled-storage/src/manager.rs:1338
5152024-11-21T19:29:59.635ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5162024-11-21T19:29:59.635ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5172024-11-21T19:29:59.724ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5182024-11-21T19:29:59.724ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone" } file = sled-storage/src/manager.rs:1338
5192024-11-21T19:29:59.792ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5202024-11-21T19:29:59.792ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/695b40ec-ab62-486b-99a5-161c372e3934/crypt/zone/oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d"), full_name: "oxp_695b40ec-ab62-486b-99a5-161c372e3934/crypt/zone/oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d" } file = sled-storage/src/manager.rs:1338
5212024-11-21T19:29:59.890ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5222024-11-21T19:29:59.890ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/695b40ec-ab62-486b-99a5-161c372e3934/crypt/zone"), full_name: "oxp_695b40ec-ab62-486b-99a5-161c372e3934/crypt/zone" } file = sled-storage/src/manager.rs:1338
5232024-11-21T19:29:59.957ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5242024-11-21T19:29:59.957ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5252024-11-21T19:30:00.046ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5262024-11-21T19:30:00.046ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318" } file = sled-storage/src/manager.rs:1338
5272024-11-21T19:30:00.142ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5282024-11-21T19:30:00.142ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/21742b4e-23b7-43df-8530-fcf02dea3824/crypt/zone/oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5"), full_name: "oxp_21742b4e-23b7-43df-8530-fcf02dea3824/crypt/zone/oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5" } file = sled-storage/src/manager.rs:1338
5292024-11-21T19:30:00.244ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5302024-11-21T19:30:00.244ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/debug"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/debug" } file = sled-storage/src/manager.rs:1338
5312024-11-21T19:30:00.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5322024-11-21T19:30:00.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crucible" } file = sled-storage/src/manager.rs:1338
5332024-11-21T19:30:00.400ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5342024-11-21T19:30:00.400ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/03f27c6c-e171-4450-8876-58f440dc9097/crypt/debug"), full_name: "oxp_03f27c6c-e171-4450-8876-58f440dc9097/crypt/debug" } file = sled-storage/src/manager.rs:1338
5352024-11-21T19:30:00.466ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5362024-11-21T19:30:00.466ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/debug"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/debug" } file = sled-storage/src/manager.rs:1338
5372024-11-21T19:30:00.477ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
5382024-11-21T19:30:00.534ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5392024-11-21T19:30:00.534ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/21742b4e-23b7-43df-8530-fcf02dea3824/crypt/zone"), full_name: "oxp_21742b4e-23b7-43df-8530-fcf02dea3824/crypt/zone" } file = sled-storage/src/manager.rs:1338
5402024-11-21T19:30:00.602ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5412024-11-21T19:30:00.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone/oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1"), full_name: "oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone/oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1" } file = sled-storage/src/manager.rs:1338
5422024-11-21T19:30:00.700ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5432024-11-21T19:30:00.700ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/784212b9-62b7-432d-b0d7-e4600fa06921/crypt/debug"), full_name: "oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crypt/debug" } file = sled-storage/src/manager.rs:1338
5442024-11-21T19:30:00.772ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5452024-11-21T19:30:00.772ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b36cfd4c-887e-4515-9f44-b45436c8de30/crypt/zone/oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5"), full_name: "oxp_b36cfd4c-887e-4515-9f44-b45436c8de30/crypt/zone/oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5" } file = sled-storage/src/manager.rs:1338
5462024-11-21T19:30:00.869ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5472024-11-21T19:30:00.869ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f/crucible" } file = sled-storage/src/manager.rs:1338
5482024-11-21T19:30:00.955ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5492024-11-21T19:30:00.955ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1" } file = sled-storage/src/manager.rs:1338
5502024-11-21T19:30:01.054ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5512024-11-21T19:30:01.054ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_03f27c6c-e171-4450-8876-58f440dc9097/crucible" } file = sled-storage/src/manager.rs:1338
5522024-11-21T19:30:01.143ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5532024-11-21T19:30:01.143ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b36cfd4c-887e-4515-9f44-b45436c8de30/crypt/debug"), full_name: "oxp_b36cfd4c-887e-4515-9f44-b45436c8de30/crypt/debug" } file = sled-storage/src/manager.rs:1338
5542024-11-21T19:30:01.212ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5552024-11-21T19:30:01.212ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2" } file = sled-storage/src/manager.rs:1338
5562024-11-21T19:30:01.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5572024-11-21T19:30:01.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/zone/oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454"), full_name: "oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/zone/oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454" } file = sled-storage/src/manager.rs:1338
5582024-11-21T19:30:01.407ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5592024-11-21T19:30:01.407ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5602024-11-21T19:30:01.479ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
5612024-11-21T19:30:01.495ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5622024-11-21T19:30:01.495ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_695b40ec-ab62-486b-99a5-161c372e3934/crucible" } file = sled-storage/src/manager.rs:1338
5632024-11-21T19:30:01.581ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5642024-11-21T19:30:01.581ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/zone"), full_name: "oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/zone" } file = sled-storage/src/manager.rs:1338
5652024-11-21T19:30:01.650ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5662024-11-21T19:30:01.650ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone/oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8"), full_name: "oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone/oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8" } file = sled-storage/src/manager.rs:1338
5672024-11-21T19:30:01.748ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5682024-11-21T19:30:01.748ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/03f27c6c-e171-4450-8876-58f440dc9097/crypt/zone/oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619"), full_name: "oxp_03f27c6c-e171-4450-8876-58f440dc9097/crypt/zone/oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619" } file = sled-storage/src/manager.rs:1338
5692024-11-21T19:30:01.848ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5702024-11-21T19:30:01.848ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crucible" } file = sled-storage/src/manager.rs:1338
5712024-11-21T19:30:01.960ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5722024-11-21T19:30:01.960ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/21742b4e-23b7-43df-8530-fcf02dea3824/crypt/debug"), full_name: "oxp_21742b4e-23b7-43df-8530-fcf02dea3824/crypt/debug" } file = sled-storage/src/manager.rs:1338
5732024-11-21T19:30:02.030ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5742024-11-21T19:30:02.030ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/debug"), full_name: "oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/debug" } file = sled-storage/src/manager.rs:1338
5752024-11-21T19:30:02.100ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5762024-11-21T19:30:02.100ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/695b40ec-ab62-486b-99a5-161c372e3934/crypt/debug"), full_name: "oxp_695b40ec-ab62-486b-99a5-161c372e3934/crypt/debug" } file = sled-storage/src/manager.rs:1338
5772024-11-21T19:30:02.169ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5782024-11-21T19:30:02.169ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone/oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038"), full_name: "oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone/oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038" } file = sled-storage/src/manager.rs:1338
5792024-11-21T19:30:02.268ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5802024-11-21T19:30:02.268ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone/oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone/oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc" } file = sled-storage/src/manager.rs:1338
5812024-11-21T19:30:02.367ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5822024-11-21T19:30:02.367ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crucible" } file = sled-storage/src/manager.rs:1338
5832024-11-21T19:30:02.457ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5842024-11-21T19:30:02.457ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/03f27c6c-e171-4450-8876-58f440dc9097/crypt/zone/oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679"), full_name: "oxp_03f27c6c-e171-4450-8876-58f440dc9097/crypt/zone/oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679" } file = sled-storage/src/manager.rs:1338
5852024-11-21T19:30:02.482ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
5862024-11-21T19:30:02.556ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5872024-11-21T19:30:02.556ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone"), full_name: "oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone" } file = sled-storage/src/manager.rs:1338
5882024-11-21T19:30:02.625ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5892024-11-21T19:30:02.625ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b36cfd4c-887e-4515-9f44-b45436c8de30/crypt/zone/oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472"), full_name: "oxp_b36cfd4c-887e-4515-9f44-b45436c8de30/crypt/zone/oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472" } file = sled-storage/src/manager.rs:1338
5902024-11-21T19:30:02.725ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5912024-11-21T19:30:02.725ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/clickhouse" } file = sled-storage/src/manager.rs:1338
5922024-11-21T19:30:02.826ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5932024-11-21T19:30:02.826ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/695b40ec-ab62-486b-99a5-161c372e3934/crypt/zone/oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e"), full_name: "oxp_695b40ec-ab62-486b-99a5-161c372e3934/crypt/zone/oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e" } file = sled-storage/src/manager.rs:1338
5942024-11-21T19:30:02.937ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5952024-11-21T19:30:02.937ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20"), full_name: "oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/zone/oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20" } file = sled-storage/src/manager.rs:1338
5962024-11-21T19:30:03.042ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5972024-11-21T19:30:03.042ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/21742b4e-23b7-43df-8530-fcf02dea3824/crypt/zone/oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35"), full_name: "oxp_21742b4e-23b7-43df-8530-fcf02dea3824/crypt/zone/oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35" } file = sled-storage/src/manager.rs:1338
5982024-11-21T19:30:03.147ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5992024-11-21T19:30:03.147ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone/oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4"), full_name: "oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crypt/zone/oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4" } file = sled-storage/src/manager.rs:1338
6002024-11-21T19:30:03.233ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4350
6012024-11-21T19:30:03.233ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4360 gateway = fd00:1122:3344:101::1
6022024-11-21T19:30:03.240ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4374 gateway = fd00:1122:3344:101::1
6032024-11-21T19:30:03.240ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4439
6042024-11-21T19:30:03.248ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2225281173851810708 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
6052024-11-21T19:30:03.248ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 484186110756405359 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
6062024-11-21T19:30:03.260ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6072024-11-21T19:30:03.260ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
6082024-11-21T19:30:03.365ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6092024-11-21T19:30:03.365ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
6102024-11-21T19:30:03.401ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4505
6112024-11-21T19:30:03.401ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4532
6122024-11-21T19:30:03.444ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4545
6132024-11-21T19:30:03.444ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4391
6142024-11-21T19:30:03.466ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6152024-11-21T19:30:03.466ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b36cfd4c-887e-4515-9f44-b45436c8de30/crucible" } file = sled-storage/src/manager.rs:1338
6162024-11-21T19:30:03.484ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
6172024-11-21T19:30:03.494ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4433
6182024-11-21T19:30:03.494ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4512 rack_subnet = fd00:1122:3344::
6192024-11-21T19:30:03.515ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4523
6202024-11-21T19:30:03.515ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4565
6212024-11-21T19:30:03.566ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6222024-11-21T19:30:03.566ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone/oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2"), full_name: "oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/zone/oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2" } file = sled-storage/src/manager.rs:1338
6232024-11-21T19:30:03.590ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4597
6242024-11-21T19:30:03.590ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4603
6252024-11-21T19:30:03.682ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6262024-11-21T19:30:03.682ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a7d01cd-9218-405e-81a7-0632ac6eff3f/crypt/debug"), full_name: "oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f/crypt/debug" } file = sled-storage/src/manager.rs:1338
6272024-11-21T19:30:03.686ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4644
6282024-11-21T19:30:03.686ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6292024-11-21T19:30:03.728ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6302024-11-21T19:30:03.729ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/nexus.rs:527 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
6312024-11-21T19:30:03.755ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6322024-11-21T19:30:03.755ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_21742b4e-23b7-43df-8530-fcf02dea3824/crucible" } file = sled-storage/src/manager.rs:1338
6332024-11-21T19:30:03.773ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6342024-11-21T19:30:03.773ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6352024-11-21T19:30:03.773ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
6362024-11-21T19:30:03.773ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6372024-11-21T19:30:03.823ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
6382024-11-21T19:30:03.847ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6392024-11-21T19:30:03.848ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-datasets.json" request = datasets_ensure
6402024-11-21T19:30:03.848ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6412024-11-21T19:30:03.848ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-datasets.json" request = datasets_ensure
6422024-11-21T19:30:03.848ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:851 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
6432024-11-21T19:30:03.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5908517 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64049 req_id = ae6ec5b1-8bf8-418f-964c-137511669e86 response_code = 200 uri = /datasets
6442024-11-21T19:30:03.878ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6452024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6462024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6472024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6482024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6492024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6502024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6512024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6522024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6532024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6542024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6552024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6562024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6572024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6582024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6592024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6602024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6612024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6622024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6632024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6642024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6652024-11-21T19:30:03.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6662024-11-21T19:30:03.879ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6672024-11-21T19:30:03.892ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 112d49fb-486a-4cde-88e1-1221a68bf3b6 (service), filesystem_pool: Some(ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0d1b3b31-4591-4bcb-931d-e8e03365f0d2 (service), filesystem_pool: Some(ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0377cf96-baf3-4e09-a570-eb7c67037d4d (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6682024-11-21T19:30:03.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38848
6692024-11-21T19:30:03.892ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6702024-11-21T19:30:03.893ZINFOSledAgent (ServiceManager): No ledger in /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json file = common/src/ledger.rs:189
6712024-11-21T19:30:03.893ZINFOSledAgent (ServiceManager): No ledger in /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json file = common/src/ledger.rs:189
6722024-11-21T19:30:03.893ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
6732024-11-21T19:30:03.893ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6742024-11-21T19:30:03.893ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6752024-11-21T19:30:03.893ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
6762024-11-21T19:30:03.893ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6772024-11-21T19:30:03.938ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6782024-11-21T19:30:03.938ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6792024-11-21T19:30:03.938ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6802024-11-21T19:30:03.993ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2 file = illumos-utils/src/zone.rs:325
6812024-11-21T19:30:03.997ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6 file = illumos-utils/src/zone.rs:325
6822024-11-21T19:30:04.001ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d file = illumos-utils/src/zone.rs:325
6832024-11-21T19:30:04.014ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2 file = illumos-utils/src/zone.rs:363
6842024-11-21T19:30:04.019ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6 file = illumos-utils/src/zone.rs:363
6852024-11-21T19:30:04.023ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d file = illumos-utils/src/zone.rs:363
6862024-11-21T19:30:04.227ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
6872024-11-21T19:30:04.227ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
6882024-11-21T19:30:04.486ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/203795ed-576b-40e4-bed8-7463e3f2162c) file = sled-agent/src/probe_manager.rs:231 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
6892024-11-21T19:30:05.615ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6902024-11-21T19:30:05.615ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6912024-11-21T19:30:05.615ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6
6922024-11-21T19:30:06.102ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6932024-11-21T19:30:06.583ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6942024-11-21T19:30:06.584ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6952024-11-21T19:30:06.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6") failed: Property not found. retry in 34.259668ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6
6962024-11-21T19:30:06.591ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6972024-11-21T19:30:06.591ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
6982024-11-21T19:30:06.596ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2
6992024-11-21T19:30:06.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6") failed: Property not found. retry in 132.379123ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6
7002024-11-21T19:30:06.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d") failed: Property not found. retry in 43.607415ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
7012024-11-21T19:30:06.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2") failed: Property not found. retry in 30.683456ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2
7022024-11-21T19:30:06.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2") failed: Property not found. retry in 100.311692ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2
7032024-11-21T19:30:06.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d") failed: Property not found. retry in 64.515858ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
7042024-11-21T19:30:06.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6") failed: Property not found. retry in 230.413447ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6
7052024-11-21T19:30:06.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d") failed: Property not found. retry in 115.733425ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
7062024-11-21T19:30:07.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2") failed: Property not found. retry in 237.749889ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2
7072024-11-21T19:30:07.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6") failed: Property not found. retry in 487.05968ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6
7082024-11-21T19:30:07.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d") failed: Property not found. retry in 395.622642ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
7092024-11-21T19:30:07.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2") failed: Property not found. retry in 388.722752ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2
7102024-11-21T19:30:07.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d") failed: Property not found. retry in 995.237053ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
7112024-11-21T19:30:07.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6") failed: Property not found. retry in 1.135045876s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6
7122024-11-21T19:30:07.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2") failed: Property not found. retry in 983.24692ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2
7132024-11-21T19:30:08.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d") failed: Property not found. retry in 1.322339504s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
7142024-11-21T19:30:08.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2") failed: Property not found. retry in 1.4252298s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2
7152024-11-21T19:30:08.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6") failed: Property not found. retry in 609.975025ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6
7162024-11-21T19:30:09.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6") failed: Property not found. retry in 1.228308137s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6
7172024-11-21T19:30:09.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d") failed: Property not found. retry in 779.00501ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
7182024-11-21T19:30:10.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2") failed: Property not found. retry in 879.373488ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2
7192024-11-21T19:30:10.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6") failed: Property not found. retry in 715.213652ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6
7202024-11-21T19:30:10.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d") failed: Property not found. retry in 921.971006ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
7212024-11-21T19:30:11.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2") failed: Property not found. retry in 701.130809ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2
7222024-11-21T19:30:11.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d") failed: Property not found. retry in 1.188383964s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
7232024-11-21T19:30:12.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_0377cf96-baf3-4e09-a570-eb7c67037d4d
7242024-11-21T19:30:12.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_0d1b3b31-4591-4bcb-931d-e8e03365f0d2
7252024-11-21T19:30:12.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_112d49fb-486a-4cde-88e1-1221a68bf3b6
7262024-11-21T19:30:12.782ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7272024-11-21T19:30:12.783ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json"
7282024-11-21T19:30:12.783ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7292024-11-21T19:30:12.783ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json"
7302024-11-21T19:30:12.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8890562 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38848 req_id = 72475972-b7e4-4d39-9a65-3affcbc7b967 response_code = 204 uri = /omicron-zones
7312024-11-21T19:30:12.786ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7322024-11-21T19:30:12.834ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7332024-11-21T19:30:12.882ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7342024-11-21T19:30:12.929ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7352024-11-21T19:30:12.929ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7362024-11-21T19:30:12.961ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7372024-11-21T19:30:12.962ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7382024-11-21T19:30:12.962ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7392024-11-21T19:30:12.991ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 112d49fb-486a-4cde-88e1-1221a68bf3b6 (service), filesystem_pool: Some(ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0d1b3b31-4591-4bcb-931d-e8e03365f0d2 (service), filesystem_pool: Some(ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0377cf96-baf3-4e09-a570-eb7c67037d4d (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 0136b26a-6758-4ad5-b364-f53a4233c038 (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a486abcd-d4a5-4b73-b0e7-1f604d44a620, kind: Service { id: 0136b26a-6758-4ad5-b364-f53a4233c038 }, name: Name("ntp-0136b26a-6758-4ad5-b364-f53a4233c038"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 194])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7402024-11-21T19:30:12.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63417
7412024-11-21T19:30:12.992ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7422024-11-21T19:30:12.992ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json file = common/src/ledger.rs:178
7432024-11-21T19:30:12.992ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json file = common/src/ledger.rs:178
7442024-11-21T19:30:12.992ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
7452024-11-21T19:30:12.992ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7462024-11-21T19:30:12.992ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7472024-11-21T19:30:12.993ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
7482024-11-21T19:30:12.993ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7492024-11-21T19:30:13.005ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7502024-11-21T19:30:13.038ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7512024-11-21T19:30:13.038ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7522024-11-21T19:30:13.038ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7532024-11-21T19:30:13.068ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 178, 194]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7542024-11-21T19:30:13.068ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = boundary_ntp
7552024-11-21T19:30:13.069ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7562024-11-21T19:30:13.069ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7572024-11-21T19:30:13.069ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7582024-11-21T19:30:13.071ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7592024-11-21T19:30:13.095ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038 file = illumos-utils/src/zone.rs:325
7602024-11-21T19:30:13.114ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038 file = illumos-utils/src/zone.rs:363
7612024-11-21T19:30:13.250ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2225281173851810708 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
7622024-11-21T19:30:13.250ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 484186110756405359 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
7632024-11-21T19:30:13.728ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7642024-11-21T19:30:13.728ZINFOSledAgent (ServiceManager): Booting oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038
7652024-11-21T19:30:13.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038") failed: Property not found. retry in 50.005662ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038
7662024-11-21T19:30:13.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038") failed: Property not found. retry in 141.328545ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038
7672024-11-21T19:30:14.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038") failed: Property not found. retry in 217.241794ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038
7682024-11-21T19:30:14.229ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
7692024-11-21T19:30:14.229ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
7702024-11-21T19:30:14.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038") failed: Property not found. retry in 576.818084ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038
7712024-11-21T19:30:14.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038") failed: Property not found. retry in 1.170518644s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038
7722024-11-21T19:30:16.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038") failed: Property not found. retry in 1.071000798s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038
7732024-11-21T19:30:17.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038") failed: Property not found. retry in 1.486044546s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038
7742024-11-21T19:30:18.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038") failed: Property not found. retry in 871.007407ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038
7752024-11-21T19:30:19.534ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038
7762024-11-21T19:30:19.534ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7772024-11-21T19:30:19.535ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json"
7782024-11-21T19:30:19.535ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7792024-11-21T19:30:19.535ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json"
7802024-11-21T19:30:19.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6543577 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63417 req_id = 5f787e1b-3b76-435a-96ad-85f6d42f0dff response_code = 204 uri = /omicron-zones
7812024-11-21T19:30:19.537ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7822024-11-21T19:30:19.567ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7832024-11-21T19:30:19.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38845
7842024-11-21T19:30:19.576ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7852024-11-21T19:30:19.576ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8717 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38845 req_id = 4178c2ff-d37c-4df1-b924-3de186757ca5 response_code = 500 uri = /timesync
7862024-11-21T19:30:19.577ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7872024-11-21T19:30:19.720ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7882024-11-21T19:30:19.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57648
7892024-11-21T19:30:21.312ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6236683478163499380 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
7902024-11-21T19:30:21.729ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14172020574873145159 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
7912024-11-21T19:30:22.785ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6501176948337382238 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
7922024-11-21T19:30:23.251ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2225281173851810708 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
7932024-11-21T19:30:23.252ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 484186110756405359 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
7942024-11-21T19:30:23.729ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7952024-11-21T19:30:23.729ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008991 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57648 req_id = a4793d3f-4e92-4147-85b2-9562a5c08027 response_code = 500 uri = /timesync
7962024-11-21T19:30:23.731ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7972024-11-21T19:30:23.940ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7982024-11-21T19:30:23.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48724
7992024-11-21T19:30:23.949ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
8002024-11-21T19:30:23.950ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8749 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48724 req_id = 3c5acd64-48e4-4cba-ab21-7179cd68b399 response_code = 500 uri = /timesync
8012024-11-21T19:30:23.952ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8022024-11-21T19:30:24.098ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8032024-11-21T19:30:24.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61349
8042024-11-21T19:30:24.231ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8052024-11-21T19:30:24.231ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8062024-11-21T19:30:27.394ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_0136b26a-6758-4ad5-b364-f53a4233c038': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
8072024-11-21T19:30:27.394ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008662 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61349 req_id = 3de832f1-6d6d-4202-9b90-1c6a273d4905 response_code = 500 uri = /timesync
8082024-11-21T19:30:27.396ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8092024-11-21T19:30:27.614ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8102024-11-21T19:30:27.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42294
8112024-11-21T19:30:27.622ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 129.033136ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8122024-11-21T19:30:27.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9368 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42294 req_id = c9be1f88-cb62-43ca-8e0d-d2d1ed392573 response_code = 200 uri = /timesync
8132024-11-21T19:30:27.625ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 8.8e-8 } file = sled-agent/src/rack_setup/service.rs:740
8142024-11-21T19:30:27.625ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8152024-11-21T19:30:27.867ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8162024-11-21T19:30:27.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44418
8172024-11-21T19:30:27.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44418 req_id = 39f5848e-8762-451f-9b21-27095e4c8ecd response_code = 200 uri = /timesync
8182024-11-21T19:30:27.878ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 8.8e-8 } file = sled-agent/src/rack_setup/service.rs:740
8192024-11-21T19:30:27.878ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8202024-11-21T19:30:28.077ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8212024-11-21T19:30:28.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64172
8222024-11-21T19:30:28.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9008 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64172 req_id = e94a9052-0bc7-4a54-9f8e-fd60e01f8cf4 response_code = 200 uri = /timesync
8232024-11-21T19:30:28.088ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.285528243 } file = sled-agent/src/rack_setup/service.rs:740
8242024-11-21T19:30:28.088ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8252024-11-21T19:30:28.349ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8262024-11-21T19:30:28.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63407
8272024-11-21T19:30:28.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9001 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63407 req_id = df0a08d4-96ba-4990-9859-0211e3444f3c response_code = 200 uri = /timesync
8282024-11-21T19:30:28.361ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.284791678 } file = sled-agent/src/rack_setup/service.rs:740
8292024-11-21T19:30:28.361ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8302024-11-21T19:30:28.658ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8312024-11-21T19:30:28.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34582
8322024-11-21T19:30:28.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8511 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34582 req_id = 8788a9ae-fe34-4fc3-9d73-2fd819960ef4 response_code = 200 uri = /timesync
8332024-11-21T19:30:28.669ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.283958435 } file = sled-agent/src/rack_setup/service.rs:740
8342024-11-21T19:30:28.669ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8352024-11-21T19:30:28.826ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15375775530993728769 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8362024-11-21T19:30:28.826ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13150227635817532293 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8372024-11-21T19:30:28.968ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8382024-11-21T19:30:28.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53749
8392024-11-21T19:30:28.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9469 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53749 req_id = 1f3161d0-5c28-45df-bb72-92cfca57c3a6 response_code = 200 uri = /timesync
8402024-11-21T19:30:28.980ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732217427.7582777, correction: 0.299725294 } file = sled-agent/src/rack_setup/service.rs:740
8412024-11-21T19:30:28.980ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8422024-11-21T19:30:29.428ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8432024-11-21T19:30:29.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62339
8442024-11-21T19:30:29.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8597 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62339 req_id = 59f01996-2e3e-4f3a-9194-fa14a6217236 response_code = 200 uri = /timesync
8452024-11-21T19:30:29.440ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732217427.7582777, correction: 0.298485428 } file = sled-agent/src/rack_setup/service.rs:740
8462024-11-21T19:30:29.440ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8472024-11-21T19:30:30.274ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8482024-11-21T19:30:30.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57197
8492024-11-21T19:30:30.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9087 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57197 req_id = 0b54a59e-07f5-4d15-bfec-f9a90d77f222 response_code = 200 uri = /timesync
8502024-11-21T19:30:30.285ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732217427.7582777, correction: 0.292354316 } file = sled-agent/src/rack_setup/service.rs:740
8512024-11-21T19:30:30.285ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8522024-11-21T19:30:30.606ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6236683478163499380 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8532024-11-21T19:30:30.978ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8542024-11-21T19:30:30.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38303
8552024-11-21T19:30:30.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38303 req_id = ae39ba68-5615-45f6-8ae8-2296c57a450c response_code = 200 uri = /timesync
8562024-11-21T19:30:30.989ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732217427.7582777, correction: 0.290452033 } file = sled-agent/src/rack_setup/service.rs:740
8572024-11-21T19:30:30.989ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8582024-11-21T19:30:31.025ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14172020574873145159 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8592024-11-21T19:30:32.084ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6501176948337382238 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8602024-11-21T19:30:32.230ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8612024-11-21T19:30:32.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52104
8622024-11-21T19:30:32.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8640 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52104 req_id = f39f802b-b5e1-43e9-b052-9af6eac868e3 response_code = 200 uri = /timesync
8632024-11-21T19:30:32.241ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3628216362, ip_addr: 216.66.48.42, stratum: 2, ref_time: 1732217432.1261322, correction: 0.269004673 } file = sled-agent/src/rack_setup/service.rs:740
8642024-11-21T19:30:32.241ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8652024-11-21T19:30:32.552ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2225281173851810708 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8662024-11-21T19:30:32.552ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 484186110756405359 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8672024-11-21T19:30:32.726ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35096
8682024-11-21T19:30:32.726ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35096 req_id = 80fd33ac-0200-4171-bfb1-a7108e612a6b response_code = 200 uri = /baseboard
8692024-11-21T19:30:32.978ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8702024-11-21T19:30:32.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61354
8712024-11-21T19:30:32.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61354 req_id = 2ca69ec0-b6d0-426a-a9ff-0a66518df537 response_code = 200 uri = /timesync
8722024-11-21T19:30:32.988ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3628216362, ip_addr: 216.66.48.42, stratum: 2, ref_time: 1732217432.1261322, correction: 0.266986817 } file = sled-agent/src/rack_setup/service.rs:740
8732024-11-21T19:30:32.988ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8742024-11-21T19:30:33.534ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8752024-11-21T19:30:33.534ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8762024-11-21T19:30:34.025ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8772024-11-21T19:30:34.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55360
8782024-11-21T19:30:34.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55360 req_id = 48828e85-c74c-4768-8743-aab559eadaae response_code = 200 uri = /timesync
8792024-11-21T19:30:34.039ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3628216362, ip_addr: 216.66.48.42, stratum: 2, ref_time: 1732217433.099596, correction: 0.2641339 } file = sled-agent/src/rack_setup/service.rs:740
8802024-11-21T19:30:34.039ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8812024-11-21T19:30:35.420ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8822024-11-21T19:30:35.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40467
8832024-11-21T19:30:35.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40467 req_id = 81def9bf-7edd-48c2-8ec7-e8e257e849e0 response_code = 200 uri = /timesync
8842024-11-21T19:30:35.432ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3628216362, ip_addr: 216.66.48.42, stratum: 2, ref_time: 1732217434.53712, correction: 0.260287166 } file = sled-agent/src/rack_setup/service.rs:740
8852024-11-21T19:30:35.432ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8862024-11-21T19:30:37.601ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8872024-11-21T19:30:37.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44830
8882024-11-21T19:30:37.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44830 req_id = f04759bb-1671-458c-ae04-f58e783d5a11 response_code = 200 uri = /timesync
8892024-11-21T19:30:37.613ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3628216362, ip_addr: 216.66.48.42, stratum: 2, ref_time: 1732217437.2346585, correction: 0.254416317 } file = sled-agent/src/rack_setup/service.rs:740
8902024-11-21T19:30:37.613ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8912024-11-21T19:30:38.855ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15375775530993728769 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8922024-11-21T19:30:38.855ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13150227635817532293 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8932024-11-21T19:30:40.286ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8942024-11-21T19:30:40.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62383
8952024-11-21T19:30:40.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8823 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62383 req_id = 0ab8f121-b1ec-4e64-9b77-e6c8d689b190 response_code = 200 uri = /timesync
8962024-11-21T19:30:40.297ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3628216362, ip_addr: 216.66.48.42, stratum: 2, ref_time: 1732217438.9454565, correction: 0.247123972 } file = sled-agent/src/rack_setup/service.rs:740
8972024-11-21T19:30:40.297ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8982024-11-21T19:30:40.637ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6236683478163499380 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
8992024-11-21T19:30:41.054ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14172020574873145159 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9002024-11-21T19:30:41.918ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9012024-11-21T19:30:41.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47588
9022024-11-21T19:30:41.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8941 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47588 req_id = 693e8500-8485-49fe-8101-589fd68752fa response_code = 200 uri = /timesync
9032024-11-21T19:30:41.929ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3628216362, ip_addr: 216.66.48.42, stratum: 2, ref_time: 1732217441.3749683, correction: 0.242747054 } file = sled-agent/src/rack_setup/service.rs:740
9042024-11-21T19:30:41.929ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9052024-11-21T19:30:42.114ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6501176948337382238 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9062024-11-21T19:30:42.581ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2225281173851810708 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9072024-11-21T19:30:42.581ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 484186110756405359 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9082024-11-21T19:30:42.826ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 681.831518ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9092024-11-21T19:30:43.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9102024-11-21T19:30:43.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9112024-11-21T19:30:44.949ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9122024-11-21T19:30:44.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63664
9132024-11-21T19:30:44.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63664 req_id = f6e502d5-7d70-4730-b5ec-6d45779c7f9d response_code = 200 uri = /timesync
9142024-11-21T19:30:44.961ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3628216362, ip_addr: 216.66.48.42, stratum: 2, ref_time: 1732217444.5419495, correction: 0.234578371 } file = sled-agent/src/rack_setup/service.rs:740
9152024-11-21T19:30:44.961ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9162024-11-21T19:30:48.885ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15375775530993728769 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9172024-11-21T19:30:48.885ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13150227635817532293 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9182024-11-21T19:30:49.225ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9192024-11-21T19:30:49.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49755
9202024-11-21T19:30:49.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8790 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49755 req_id = ad5f0419-a716-43ea-ac6a-30b0cc48f392 response_code = 200 uri = /timesync
9212024-11-21T19:30:49.236ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3628216362, ip_addr: 216.66.48.42, stratum: 2, ref_time: 1732217447.8645546, correction: 0.223025575 } file = sled-agent/src/rack_setup/service.rs:740
9222024-11-21T19:30:49.236ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9232024-11-21T19:30:50.666ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6236683478163499380 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9242024-11-21T19:30:51.082ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14172020574873145159 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9252024-11-21T19:30:52.144ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6501176948337382238 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9262024-11-21T19:30:52.609ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2225281173851810708 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9272024-11-21T19:30:52.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 484186110756405359 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9282024-11-21T19:30:53.593ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9292024-11-21T19:30:53.593ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9302024-11-21T19:30:54.163ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9312024-11-21T19:30:54.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40225
9322024-11-21T19:30:54.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40225 req_id = 3e23bb97-1cfe-4f32-8cf7-46496fa7794c response_code = 200 uri = /timesync
9332024-11-21T19:30:54.176ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2907128903, ip_addr: 173.71.68.71, stratum: 2, ref_time: 1732217453.5418575, correction: 0.206899762 } file = sled-agent/src/rack_setup/service.rs:740
9342024-11-21T19:30:54.176ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9352024-11-21T19:30:57.965ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9362024-11-21T19:30:57.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41938
9372024-11-21T19:30:57.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41938 req_id = 15f71a35-ca26-4a97-af12-cfe3a5a7ebd7 response_code = 200 uri = /timesync
9382024-11-21T19:30:57.977ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2907128903, ip_addr: 173.71.68.71, stratum: 2, ref_time: 1732217453.5418575, correction: 0.196633294 } file = sled-agent/src/rack_setup/service.rs:740
9392024-11-21T19:30:57.977ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9402024-11-21T19:30:58.586ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.360620074s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9412024-11-21T19:30:58.914ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15375775530993728769 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9422024-11-21T19:30:58.914ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13150227635817532293 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9432024-11-21T19:31:00.696ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6236683478163499380 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9442024-11-21T19:31:01.110ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14172020574873145159 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9452024-11-21T19:31:02.172ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6501176948337382238 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9462024-11-21T19:31:02.637ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2225281173851810708 reason = Duration(60s) sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9472024-11-21T19:31:02.638ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 484186110756405359 reason = Duration(60s) sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9482024-11-21T19:31:02.842ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60231
9492024-11-21T19:31:02.842ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60231 req_id = 881ba151-d852-46a0-8d0b-f2104f733191 response_code = 200 uri = /baseboard
9502024-11-21T19:31:03.622ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9512024-11-21T19:31:03.622ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9522024-11-21T19:31:04.426ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9532024-11-21T19:31:04.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35190
9542024-11-21T19:31:04.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9013 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35190 req_id = 2a5a61b0-09ff-4dbd-b782-1f5d4ebc7444 response_code = 200 uri = /timesync
9552024-11-21T19:31:04.438ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2907128903, ip_addr: 173.71.68.71, stratum: 2, ref_time: 1732217453.5418575, correction: 0.179182664 } file = sled-agent/src/rack_setup/service.rs:740
9562024-11-21T19:31:04.438ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9572024-11-21T19:31:08.735ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9582024-11-21T19:31:08.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36013
9592024-11-21T19:31:08.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9644 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36013 req_id = c4b7e79b-2921-4c48-aa53-f15f71a264fa response_code = 200 uri = /timesync
9602024-11-21T19:31:08.748ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2907128903, ip_addr: 173.71.68.71, stratum: 2, ref_time: 1732217464.9900718, correction: 0.167516083 } file = sled-agent/src/rack_setup/service.rs:740
9612024-11-21T19:31:08.748ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9622024-11-21T19:31:08.945ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15375775530993728769 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9632024-11-21T19:31:08.945ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13150227635817532293 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9642024-11-21T19:31:10.725ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6236683478163499380 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9652024-11-21T19:31:11.138ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14172020574873145159 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9662024-11-21T19:31:12.200ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6501176948337382238 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9672024-11-21T19:31:13.651ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9682024-11-21T19:31:13.651ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9692024-11-21T19:31:15.028ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.136915448s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9702024-11-21T19:31:16.063ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9712024-11-21T19:31:16.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65185
9722024-11-21T19:31:16.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65185 req_id = 3eb5c94f-cdfa-4d3a-8a85-50526d517e95 response_code = 200 uri = /timesync
9732024-11-21T19:31:16.075ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2907128903, ip_addr: 173.71.68.71, stratum: 2, ref_time: 1732217473.3334508, correction: 0.147758275 } file = sled-agent/src/rack_setup/service.rs:740
9742024-11-21T19:31:16.075ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9752024-11-21T19:31:18.974ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15375775530993728769 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9762024-11-21T19:31:18.975ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13150227635817532293 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9772024-11-21T19:31:20.754ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6236683478163499380 reason = Duration(60s) sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9782024-11-21T19:31:21.167ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14172020574873145159 reason = Duration(60s) sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9792024-11-21T19:31:22.230ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6501176948337382238 reason = Duration(60s) sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9802024-11-21T19:31:23.680ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9812024-11-21T19:31:23.680ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9822024-11-21T19:31:29.004ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15375775530993728769 reason = Duration(60s) sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9832024-11-21T19:31:29.005ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13150227635817532293 reason = Duration(60s) sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9842024-11-21T19:31:32.247ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.878354464s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9852024-11-21T19:31:32.956ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50179
9862024-11-21T19:31:32.956ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50179 req_id = 92981653-6c68-45b6-9500-774b80f05792 response_code = 200 uri = /baseboard
9872024-11-21T19:31:33.095ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9882024-11-21T19:31:33.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61572
9892024-11-21T19:31:33.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9607 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61572 req_id = 24a15fc0-8b81-4ecf-9e2f-dbcc74ea8bc8 response_code = 200 uri = /timesync
9902024-11-21T19:31:33.107ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2907128903, ip_addr: 173.71.68.71, stratum: 2, ref_time: 1732217473.3334508, correction: 0.101753637 } file = sled-agent/src/rack_setup/service.rs:740
9912024-11-21T19:31:33.107ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9922024-11-21T19:31:33.710ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9932024-11-21T19:31:33.710ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9942024-11-21T19:31:43.739ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14929694437859465850 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9952024-11-21T19:31:43.740ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11145020009661285028 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9962024-11-21T19:31:53.217ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.798253195s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
9972024-11-21T19:31:53.702ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9982024-11-21T19:31:53.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43963
9992024-11-21T19:31:53.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43963 req_id = 07ad53e8-66d6-42bf-97cc-c0f43174145b response_code = 200 uri = /timesync
10002024-11-21T19:31:53.727ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-21T19:31:29.004688342Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15375775530993728769 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
10012024-11-21T19:31:53.727ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-21T19:31:29.005026442Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13150227635817532293 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
10022024-11-21T19:31:53.728ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-21T19:31:22.230601067Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6501176948337382238 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
10032024-11-21T19:31:53.728ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-21T19:31:02.637440615Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2225281173851810708 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
10042024-11-21T19:31:53.728ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-21T19:31:02.638130849Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 484186110756405359 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
10052024-11-21T19:31:53.728ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-21T19:31:20.754346801Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6236683478163499380 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
10062024-11-21T19:31:53.728ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-21T19:31:21.167064636Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14172020574873145159 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
10072024-11-21T19:31:53.729ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2907128903, ip_addr: 173.71.68.71, stratum: 2, ref_time: 1732217473.3334508, correction: 0.046093892 } file = sled-agent/src/rack_setup/service.rs:740
10082024-11-21T19:31:53.729ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
10092024-11-21T19:31:53.759ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 112d49fb-486a-4cde-88e1-1221a68bf3b6 (service), filesystem_pool: Some(ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0d1b3b31-4591-4bcb-931d-e8e03365f0d2 (service), filesystem_pool: Some(ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0377cf96-baf3-4e09-a570-eb7c67037d4d (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 0136b26a-6758-4ad5-b364-f53a4233c038 (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a486abcd-d4a5-4b73-b0e7-1f604d44a620, kind: Service { id: 0136b26a-6758-4ad5-b364-f53a4233c038 }, name: Name("ntp-0136b26a-6758-4ad5-b364-f53a4233c038"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 194])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: b62bf12e-c67b-4a78-937e-322230da8e1d (service), filesystem_pool: Some(ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External } } } }, OmicronZoneConfig { id: 79d9d42d-4227-48a4-8c55-f6743d9bd839 (service), filesystem_pool: Some(ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8 (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External } } } }, OmicronZoneConfig { id: 793b523c-f13b-44bd-b2cf-0fee92f1dab5 (service), filesystem_pool: Some(ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2ed495f5-f9ed-49df-a66f-275b1f2ae454 (service), filesystem_pool: Some(ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10102024-11-21T19:31:53.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63818
10112024-11-21T19:31:53.759ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10122024-11-21T19:31:53.760ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json file = common/src/ledger.rs:178
10132024-11-21T19:31:53.760ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json file = common/src/ledger.rs:178
10142024-11-21T19:31:53.760ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
10152024-11-21T19:31:53.760ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10162024-11-21T19:31:53.760ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10172024-11-21T19:31:53.760ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
10182024-11-21T19:31:53.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10192024-11-21T19:31:53.845ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10202024-11-21T19:31:53.845ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10212024-11-21T19:31:53.845ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10222024-11-21T19:31:53.845ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10232024-11-21T19:31:53.845ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10242024-11-21T19:31:53.937ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454 file = illumos-utils/src/zone.rs:325
10252024-11-21T19:31:53.941ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839 file = illumos-utils/src/zone.rs:325
10262024-11-21T19:31:53.945ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8 file = illumos-utils/src/zone.rs:325
10272024-11-21T19:31:53.949ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d file = illumos-utils/src/zone.rs:325
10282024-11-21T19:31:53.954ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5 file = illumos-utils/src/zone.rs:325
10292024-11-21T19:31:53.958ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454 file = illumos-utils/src/zone.rs:363
10302024-11-21T19:31:53.962ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839 file = illumos-utils/src/zone.rs:363
10312024-11-21T19:31:53.967ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8 file = illumos-utils/src/zone.rs:363
10322024-11-21T19:31:53.972ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d file = illumos-utils/src/zone.rs:363
10332024-11-21T19:31:53.976ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5 file = illumos-utils/src/zone.rs:363
10342024-11-21T19:31:57.051ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='793b523c-f13b-44bd-b2cf-0fee92f1dab5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10352024-11-21T19:31:57.051ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10362024-11-21T19:31:57.102ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10372024-11-21T19:31:57.102ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10382024-11-21T19:31:57.108ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='79d9d42d-4227-48a4-8c55-f6743d9bd839'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10392024-11-21T19:31:57.108ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10402024-11-21T19:31:57.113ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b62bf12e-c67b-4a78-937e-322230da8e1d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10412024-11-21T19:31:57.114ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10422024-11-21T19:31:57.186ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2ed495f5-f9ed-49df-a66f-275b1f2ae454'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10432024-11-21T19:31:57.186ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10442024-11-21T19:31:57.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 44.590441ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10452024-11-21T19:31:57.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 32.081868ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10462024-11-21T19:31:57.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 51.026537ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10472024-11-21T19:31:57.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 37.198305ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10482024-11-21T19:31:57.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 138.49449ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10492024-11-21T19:31:57.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 143.964043ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10502024-11-21T19:31:57.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 76.443151ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10512024-11-21T19:31:57.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 75.640344ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10522024-11-21T19:31:57.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 119.569499ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10532024-11-21T19:31:57.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 206.302643ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10542024-11-21T19:31:57.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 205.30305ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10552024-11-21T19:31:58.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 134.537956ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10562024-11-21T19:31:58.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 442.847764ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10572024-11-21T19:31:58.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 338.717549ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10582024-11-21T19:31:58.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 261.066819ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10592024-11-21T19:31:58.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 31.177203ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10602024-11-21T19:31:58.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 398.50218ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10612024-11-21T19:31:58.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 64.409843ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10622024-11-21T19:31:58.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 239.214007ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10632024-11-21T19:31:58.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 918.243546ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10642024-11-21T19:31:58.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 1.158512112s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10652024-11-21T19:31:58.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 918.077807ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10662024-11-21T19:31:58.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 263.634988ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10672024-11-21T19:31:58.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 762.90153ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10682024-11-21T19:31:59.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 491.932837ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10692024-11-21T19:31:59.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 901.868417ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10702024-11-21T19:31:59.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 543.998381ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10712024-11-21T19:31:59.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 769.759078ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10722024-11-21T19:31:59.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 718.742388ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10732024-11-21T19:31:59.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 994.211025ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10742024-11-21T19:32:00.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 1.427342637s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10752024-11-21T19:32:00.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 853.856131ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10762024-11-21T19:32:00.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 978.774277ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10772024-11-21T19:32:00.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 651.016001ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10782024-11-21T19:32:00.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 1.450450379s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10792024-11-21T19:32:01.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 1.078246114s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10802024-11-21T19:32:01.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 629.074043ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10812024-11-21T19:32:01.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 912.227029ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10822024-11-21T19:32:01.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 723.237237ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10832024-11-21T19:32:01.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 624.500677ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10842024-11-21T19:32:02.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 1.073147366s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10852024-11-21T19:32:02.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 1.176666053s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10862024-11-21T19:32:02.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 1.308519722s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10872024-11-21T19:32:02.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 586.278055ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10882024-11-21T19:32:02.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 1.088811051s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10892024-11-21T19:32:02.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 913.680009ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10902024-11-21T19:32:03.071ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41640
10912024-11-21T19:32:03.072ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41640 req_id = 56705c96-f1d3-42c9-8a2b-caf412b39987 response_code = 200 uri = /baseboard
10922024-11-21T19:32:03.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 579.96852ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10932024-11-21T19:32:03.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 632.014213ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10942024-11-21T19:32:03.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 1.073219279s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
10952024-11-21T19:32:03.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 1.087094445s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
10962024-11-21T19:32:03.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 1.370448854s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
10972024-11-21T19:32:03.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 883.241501ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
10982024-11-21T19:32:04.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 1.374568224s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
10992024-11-21T19:32:04.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 791.805118ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
11002024-11-21T19:32:04.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 761.144005ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
11012024-11-21T19:32:04.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 1.491339482s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
11022024-11-21T19:32:05.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 1.473159506s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
11032024-11-21T19:32:05.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 1.403585638s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
11042024-11-21T19:32:05.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 1.481280695s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
11052024-11-21T19:32:05.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 585.991458ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
11062024-11-21T19:32:06.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 612.708457ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
11072024-11-21T19:32:06.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454") failed: Property not found. retry in 1.145695575s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
11082024-11-21T19:32:06.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 842.595828ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
11092024-11-21T19:32:06.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5") failed: Property not found. retry in 1.210370947s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
11102024-11-21T19:32:06.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 586.060913ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
11112024-11-21T19:32:07.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d") failed: Property not found. retry in 662.049168ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
11122024-11-21T19:32:07.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8") failed: Property not found. retry in 774.24538ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
11132024-11-21T19:32:07.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839") failed: Property not found. retry in 1.095809627s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
11142024-11-21T19:32:08.702ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_2ed495f5-f9ed-49df-a66f-275b1f2ae454
11152024-11-21T19:32:08.702ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_79d9d42d-4227-48a4-8c55-f6743d9bd839
11162024-11-21T19:32:08.702ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8
11172024-11-21T19:32:08.702ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_b62bf12e-c67b-4a78-937e-322230da8e1d
11182024-11-21T19:32:08.702ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_793b523c-f13b-44bd-b2cf-0fee92f1dab5
11192024-11-21T19:32:08.702ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
11202024-11-21T19:32:08.703ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json"
11212024-11-21T19:32:08.703ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
11222024-11-21T19:32:08.703ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json"
11232024-11-21T19:32:08.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14903294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63818 req_id = 1b6d24fa-d15a-4522-ae8d-2271aa0ced16 response_code = 204 uri = /omicron-zones
11242024-11-21T19:32:08.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58910
11252024-11-21T19:32:08.766ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28186 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58910 req_id = 02113d6d-d6a6-4b3c-a2fc-1cf717141287 response_code = 500 uri = /cockroachdb
11262024-11-21T19:32:08.767ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "02113d6d-d6a6-4b3c-a2fc-1cf717141287", "content-length": "124", "date": "Thu, 21 Nov 2024 19:32:08 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "02113d6d-d6a6-4b3c-a2fc-1cf717141287" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 101.349277ms
11272024-11-21T19:32:08.898ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58910 req_id = 39160a93-bc03-4cd2-96cd-acb647619a9b response_code = 500 uri = /cockroachdb
11282024-11-21T19:32:08.898ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "39160a93-bc03-4cd2-96cd-acb647619a9b", "content-length": "124", "date": "Thu, 21 Nov 2024 19:32:08 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "39160a93-bc03-4cd2-96cd-acb647619a9b" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 153.697517ms
11292024-11-21T19:32:09.080ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26907 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58910 req_id = bd7f031e-1988-4c82-8ca5-0a6e5d20e9e7 response_code = 500 uri = /cockroachdb
11302024-11-21T19:32:09.081ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bd7f031e-1988-4c82-8ca5-0a6e5d20e9e7", "content-length": "124", "date": "Thu, 21 Nov 2024 19:32:08 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bd7f031e-1988-4c82-8ca5-0a6e5d20e9e7" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 133.18204ms
11312024-11-21T19:32:09.243ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58910 req_id = 217ca311-7fc3-46a1-949a-154d5be134b6 response_code = 500 uri = /cockroachdb
11322024-11-21T19:32:09.243ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "217ca311-7fc3-46a1-949a-154d5be134b6", "content-length": "124", "date": "Thu, 21 Nov 2024 19:32:08 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "217ca311-7fc3-46a1-949a-154d5be134b6" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 92.706019ms
11332024-11-21T19:32:09.366ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28465 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58910 req_id = c2906474-c830-4286-8916-67cc30d4dac9 response_code = 500 uri = /cockroachdb
11342024-11-21T19:32:09.367ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c2906474-c830-4286-8916-67cc30d4dac9", "content-length": "124", "date": "Thu, 21 Nov 2024 19:32:08 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c2906474-c830-4286-8916-67cc30d4dac9" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 212.610103ms
11352024-11-21T19:32:09.613ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3801
11362024-11-21T19:32:26.691ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3819
11372024-11-21T19:32:36.424ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3842
11382024-11-21T19:32:36.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26839300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58910 req_id = 55d35e13-1373-405a-8dab-1f51f980c9c6 response_code = 204 uri = /cockroachdb
11392024-11-21T19:32:36.426ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57279
11402024-11-21T19:32:36.427ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57279 req_id = 5e2ddd9b-2b85-45c7-a0a1-7449134a0b3c response_code = 200 uri = /baseboard
11412024-11-21T19:32:36.439ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 21.602757355s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
11422024-11-21T19:32:36.472ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 112d49fb-486a-4cde-88e1-1221a68bf3b6 (service), filesystem_pool: Some(ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0d1b3b31-4591-4bcb-931d-e8e03365f0d2 (service), filesystem_pool: Some(ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0377cf96-baf3-4e09-a570-eb7c67037d4d (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 0136b26a-6758-4ad5-b364-f53a4233c038 (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a486abcd-d4a5-4b73-b0e7-1f604d44a620, kind: Service { id: 0136b26a-6758-4ad5-b364-f53a4233c038 }, name: Name("ntp-0136b26a-6758-4ad5-b364-f53a4233c038"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 194])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: b62bf12e-c67b-4a78-937e-322230da8e1d (service), filesystem_pool: Some(ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External } } } }, OmicronZoneConfig { id: 79d9d42d-4227-48a4-8c55-f6743d9bd839 (service), filesystem_pool: Some(ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1c2e9f31-b8bd-4a6a-aef0-78de1c20cad8 (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External } } } }, OmicronZoneConfig { id: 793b523c-f13b-44bd-b2cf-0fee92f1dab5 (service), filesystem_pool: Some(ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2ed495f5-f9ed-49df-a66f-275b1f2ae454 (service), filesystem_pool: Some(ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 (service), filesystem_pool: Some(ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d (service), filesystem_pool: Some(ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 (service), filesystem_pool: Some(ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 088dbd0f-363c-4785-9d04-aa968256294e (service), filesystem_pool: Some(ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 915e11b8-d7cb-4730-9906-7980540813dc (service), filesystem_pool: Some(ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5fb99117-c685-44d5-bec2-c58adb63b619 (service), filesystem_pool: Some(ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 33315960-bb75-402f-b35f-57bf31aa7fa1 (service), filesystem_pool: Some(ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External } } } }, OmicronZoneConfig { id: 977761ce-56db-4d7f-989a-1753926c4318 (service), filesystem_pool: Some(ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: d6f3e611-5df4-4398-95ef-e3e39c36b3c0 (service), filesystem_pool: Some(ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: aca54066-e79b-4cbd-9f73-6d281b0ecad4 (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 3a5c9363-d084-4653-b4b3-41d106294d20 (service), filesystem_pool: Some(ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External } } } }, OmicronZoneConfig { id: c5fdcef6-931d-4d38-9395-118db152ff3c (service), filesystem_pool: Some(ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5bce18f9-02f8-49f9-ba47-3434651d04e1 (service), filesystem_pool: Some(ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External } } } }, OmicronZoneConfig { id: a9850f8a-24b5-462c-9595-ec017b921a35 (service), filesystem_pool: Some(ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0256a788-b2d9-40a4-a221-ded4046dad4e (service), filesystem_pool: Some(ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External } } } }, OmicronZoneConfig { id: a2c5d597-7f38-4da5-8720-0f0a0f767679 (service), filesystem_pool: Some(ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External } } } }, OmicronZoneConfig { id: 79820cb2-812b-4ec3-9d9d-10275f4f45bb (service), filesystem_pool: Some(ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External } } } }, OmicronZoneConfig { id: 0549559a-36c0-43cd-9345-712a6ce4085d (service), filesystem_pool: Some(ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External } } } }, OmicronZoneConfig { id: 796986f8-873c-4bb4-aba3-115f6ba0f472 (service), filesystem_pool: Some(ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11432024-11-21T19:32:36.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37036
11442024-11-21T19:32:36.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11452024-11-21T19:32:36.474ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json file = common/src/ledger.rs:178
11462024-11-21T19:32:36.474ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json file = common/src/ledger.rs:178
11472024-11-21T19:32:36.474ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
11482024-11-21T19:32:36.474ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11492024-11-21T19:32:36.475ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11502024-11-21T19:32:36.475ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
11512024-11-21T19:32:36.476ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11522024-11-21T19:32:36.670ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11532024-11-21T19:32:36.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11542024-11-21T19:32:36.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11552024-11-21T19:32:36.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11562024-11-21T19:32:36.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11572024-11-21T19:32:36.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11582024-11-21T19:32:36.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11592024-11-21T19:32:36.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11602024-11-21T19:32:36.672ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11612024-11-21T19:32:36.673ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11622024-11-21T19:32:36.844ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11632024-11-21T19:32:36.844ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11642024-11-21T19:32:36.844ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11652024-11-21T19:32:36.873ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11662024-11-21T19:32:36.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11672024-11-21T19:32:36.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11682024-11-21T19:32:36.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11692024-11-21T19:32:36.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11702024-11-21T19:32:36.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11712024-11-21T19:32:36.888ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20 file = illumos-utils/src/zone.rs:325
11722024-11-21T19:32:36.893ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb file = illumos-utils/src/zone.rs:325
11732024-11-21T19:32:36.898ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318 file = illumos-utils/src/zone.rs:325
11742024-11-21T19:32:36.903ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c file = illumos-utils/src/zone.rs:325
11752024-11-21T19:32:36.908ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d file = illumos-utils/src/zone.rs:325
11762024-11-21T19:32:36.913ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472 file = illumos-utils/src/zone.rs:325
11772024-11-21T19:32:36.919ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1 file = illumos-utils/src/zone.rs:325
11782024-11-21T19:32:37.058ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20 file = illumos-utils/src/zone.rs:363
11792024-11-21T19:32:37.063ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb file = illumos-utils/src/zone.rs:363
11802024-11-21T19:32:37.068ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318 file = illumos-utils/src/zone.rs:363
11812024-11-21T19:32:37.072ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c file = illumos-utils/src/zone.rs:363
11822024-11-21T19:32:37.077ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d file = illumos-utils/src/zone.rs:363
11832024-11-21T19:32:37.081ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472 file = illumos-utils/src/zone.rs:363
11842024-11-21T19:32:37.086ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1 file = illumos-utils/src/zone.rs:363
11852024-11-21T19:32:37.091ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1 file = illumos-utils/src/zone.rs:325
11862024-11-21T19:32:37.096ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35 file = illumos-utils/src/zone.rs:325
11872024-11-21T19:32:37.102ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e file = illumos-utils/src/zone.rs:325
11882024-11-21T19:32:37.109ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4 file = illumos-utils/src/zone.rs:325
11892024-11-21T19:32:37.115ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619 file = illumos-utils/src/zone.rs:325
11902024-11-21T19:32:37.121ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679 file = illumos-utils/src/zone.rs:325
11912024-11-21T19:32:37.128ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0 file = illumos-utils/src/zone.rs:325
11922024-11-21T19:32:37.136ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1 file = illumos-utils/src/zone.rs:363
11932024-11-21T19:32:37.144ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35 file = illumos-utils/src/zone.rs:363
11942024-11-21T19:32:37.152ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e file = illumos-utils/src/zone.rs:363
11952024-11-21T19:32:37.160ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4 file = illumos-utils/src/zone.rs:363
11962024-11-21T19:32:37.168ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619 file = illumos-utils/src/zone.rs:363
11972024-11-21T19:32:37.177ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679 file = illumos-utils/src/zone.rs:363
11982024-11-21T19:32:37.197ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0 file = illumos-utils/src/zone.rs:363
11992024-11-21T19:32:37.316ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12002024-11-21T19:32:37.437ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12012024-11-21T19:32:37.502ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12022024-11-21T19:32:37.572ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12032024-11-21T19:32:37.636ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12042024-11-21T19:32:37.638ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12052024-11-21T19:32:37.638ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12062024-11-21T19:32:37.699ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 235, 243]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12072024-11-21T19:32:37.699ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12082024-11-21T19:32:37.701ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12092024-11-21T19:32:37.701ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12102024-11-21T19:32:37.760ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 183, 146]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12112024-11-21T19:32:37.760ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12122024-11-21T19:32:37.762ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12132024-11-21T19:32:37.762ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12142024-11-21T19:32:37.818ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 164, 205]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12152024-11-21T19:32:37.818ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12162024-11-21T19:32:37.820ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12172024-11-21T19:32:37.820ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12182024-11-21T19:32:37.876ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 156, 188]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12192024-11-21T19:32:37.876ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
12202024-11-21T19:32:37.878ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12212024-11-21T19:32:37.878ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12222024-11-21T19:32:37.933ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 192, 185]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12232024-11-21T19:32:37.933ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
12242024-11-21T19:32:37.934ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12252024-11-21T19:32:37.934ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12262024-11-21T19:32:37.935ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12272024-11-21T19:32:37.935ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12282024-11-21T19:32:37.935ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12292024-11-21T19:32:37.935ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12302024-11-21T19:32:37.936ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
12312024-11-21T19:32:37.936ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
12322024-11-21T19:32:37.936ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12332024-11-21T19:32:37.936ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12342024-11-21T19:32:37.945ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12352024-11-21T19:32:37.947ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12362024-11-21T19:32:37.947ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12372024-11-21T19:32:37.951ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12382024-11-21T19:32:38.013ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
12392024-11-21T19:32:38.018ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12402024-11-21T19:32:38.018ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12412024-11-21T19:32:38.021ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12422024-11-21T19:32:38.022ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12432024-11-21T19:32:38.081ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e file = illumos-utils/src/zone.rs:325
12442024-11-21T19:32:38.168ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12452024-11-21T19:32:38.204ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc file = illumos-utils/src/zone.rs:325
12462024-11-21T19:32:38.216ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e file = illumos-utils/src/zone.rs:363
12472024-11-21T19:32:38.230ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d file = illumos-utils/src/zone.rs:325
12482024-11-21T19:32:38.244ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2 file = illumos-utils/src/zone.rs:325
12492024-11-21T19:32:38.255ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5 file = illumos-utils/src/zone.rs:325
12502024-11-21T19:32:38.268ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc file = illumos-utils/src/zone.rs:363
12512024-11-21T19:32:38.297ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5 file = illumos-utils/src/zone.rs:363
12522024-11-21T19:32:38.319ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d file = illumos-utils/src/zone.rs:363
12532024-11-21T19:32:38.361ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2 file = illumos-utils/src/zone.rs:363
12542024-11-21T19:32:52.080ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12552024-11-21T19:32:52.081ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
12562024-11-21T19:32:52.125ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12572024-11-21T19:32:52.130ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
12582024-11-21T19:32:52.152ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1a8789bb-e734-4e72-99e6-ba05e2c7903a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12592024-11-21T19:32:52.152ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
12602024-11-21T19:32:52.162ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_03f27c6c-e171-4450-8876-58f440dc9097/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0545d82b-01ce-44de-b5b5-0017be0af7ef'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12612024-11-21T19:32:52.163ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_784212b9-62b7-432d-b0d7-e4600fa06921/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cd67aabc-736f-4644-aeaa-d6dd5e529896'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12622024-11-21T19:32:52.163ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_21742b4e-23b7-43df-8530-fcf02dea3824/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ab99dc49-e65d-412b-8ab4-47f8898f8b08'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12632024-11-21T19:32:52.163ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
12642024-11-21T19:32:52.172ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
12652024-11-21T19:32:52.178ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
12662024-11-21T19:32:52.185ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bb2b4b8f-515b-44d9-9a6e-b6b311fa79b9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12672024-11-21T19:32:52.186ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4c2a5007-b078-451f-869c-39fdeb01dd17'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12682024-11-21T19:32:52.187ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_695b40ec-ab62-486b-99a5-161c372e3934/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='42996cb6-d80a-4356-8510-7d8a050a5123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12692024-11-21T19:32:52.188ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b36cfd4c-887e-4515-9f44-b45436c8de30/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7af4282c-edf4-4040-858a-2df002d42521'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12702024-11-21T19:32:52.188ZINFOSledAgent (ServiceManager): Booting oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
12712024-11-21T19:32:52.193ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
12722024-11-21T19:32:52.199ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
12732024-11-21T19:32:52.207ZINFOSledAgent (ServiceManager): Booting oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
12742024-11-21T19:32:52.620ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12752024-11-21T19:32:52.620ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
12762024-11-21T19:32:52.704ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_11d53b36-56c4-493b-908d-a4b25d43b82e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='88624c49-5b48-4475-b706-6f6a40f5f774'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12772024-11-21T19:32:52.704ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
12782024-11-21T19:32:52.726ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='5fb99117-c685-44d5-bec2-c58adb63b619'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12792024-11-21T19:32:52.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 43.924666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
12802024-11-21T19:32:52.755ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
12812024-11-21T19:32:52.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 35.724986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
12822024-11-21T19:32:52.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 30.17851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
12832024-11-21T19:32:52.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 54.914313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
12842024-11-21T19:32:52.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 46.421599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
12852024-11-21T19:32:52.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 67.193232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
12862024-11-21T19:32:52.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 58.257033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
12872024-11-21T19:32:52.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 56.868458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
12882024-11-21T19:32:52.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 62.397379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
12892024-11-21T19:32:52.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 60.300713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
12902024-11-21T19:32:52.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 131.885428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
12912024-11-21T19:32:52.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 140.873154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
12922024-11-21T19:32:52.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 147.84231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
12932024-11-21T19:32:52.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 88.471074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
12942024-11-21T19:32:52.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 54.815026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
12952024-11-21T19:32:52.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 142.368409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
12962024-11-21T19:32:52.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 72.218932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
12972024-11-21T19:32:52.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 57.362107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
12982024-11-21T19:32:52.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 122.549976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
12992024-11-21T19:32:52.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 31.041532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
13002024-11-21T19:32:52.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 99.429315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
13012024-11-21T19:32:52.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 124.228238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
13022024-11-21T19:32:52.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 214.545845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
13032024-11-21T19:32:53.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 30.289981ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
13042024-11-21T19:32:53.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 144.356481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
13052024-11-21T19:32:53.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 115.739294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
13062024-11-21T19:32:53.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 137.917223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
13072024-11-21T19:32:53.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 54.381796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
13082024-11-21T19:32:53.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 237.077457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
13092024-11-21T19:32:53.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 101.820743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
13102024-11-21T19:32:53.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 176.288718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
13112024-11-21T19:32:53.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 200.557662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
13122024-11-21T19:32:53.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 118.736636ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
13132024-11-21T19:32:53.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 202.952356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
13142024-11-21T19:32:53.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 141.253871ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
13152024-11-21T19:32:53.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 196.102682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
13162024-11-21T19:32:53.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 419.343111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
13172024-11-21T19:32:53.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 176.886364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
13182024-11-21T19:32:53.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 284.612855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
13192024-11-21T19:32:53.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 229.060682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
13202024-11-21T19:32:53.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 276.07037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
13212024-11-21T19:32:53.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 467.183655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
13222024-11-21T19:32:53.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 468.666484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
13232024-11-21T19:32:53.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 599.027217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
13242024-11-21T19:32:53.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 217.012739ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
13252024-11-21T19:32:53.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 244.802335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
13262024-11-21T19:32:53.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 429.811965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
13272024-11-21T19:32:53.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 458.619912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
13282024-11-21T19:32:53.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 453.485794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
13292024-11-21T19:32:53.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 372.415145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
13302024-11-21T19:32:53.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 427.017372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
13312024-11-21T19:32:53.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 294.819114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
13322024-11-21T19:32:53.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 724.349708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
13332024-11-21T19:32:53.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 316.184549ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
13342024-11-21T19:32:53.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 935.240621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
13352024-11-21T19:32:53.655ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13362024-11-21T19:32:53.655ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
13372024-11-21T19:32:53.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 1.143113227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
13382024-11-21T19:32:53.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 906.821496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
13392024-11-21T19:32:53.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 565.295385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
13402024-11-21T19:32:53.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 702.3164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
13412024-11-21T19:32:53.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 899.402173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
13422024-11-21T19:32:53.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 802.419827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
13432024-11-21T19:32:53.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 37.232671ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
13442024-11-21T19:32:53.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 1.162335667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
13452024-11-21T19:32:53.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 661.495125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
13462024-11-21T19:32:53.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 500.961989ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
13472024-11-21T19:32:53.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 56.545527ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
13482024-11-21T19:32:53.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 966.922378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
13492024-11-21T19:32:53.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 730.583105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
13502024-11-21T19:32:54.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 157.187933ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
13512024-11-21T19:32:54.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 298.124413ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
13522024-11-21T19:32:54.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 1.496346152s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
13532024-11-21T19:32:54.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 1.418129304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
13542024-11-21T19:32:54.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 1.058200179s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
13552024-11-21T19:32:54.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 970.808399ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
13562024-11-21T19:32:54.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 770.347771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
13572024-11-21T19:32:54.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 829.819331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
13582024-11-21T19:32:54.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 1.303213349s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
13592024-11-21T19:32:54.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 1.226499055s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
13602024-11-21T19:32:54.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 1.326567086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
13612024-11-21T19:32:54.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 1.312850348s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
13622024-11-21T19:32:54.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 1.11654292s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
13632024-11-21T19:32:54.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 1.245832123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
13642024-11-21T19:32:54.892ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13652024-11-21T19:32:54.892ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13662024-11-21T19:32:54.892ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13672024-11-21T19:32:54.892ZINFOSledAgent (ServiceManager): Booting oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
13682024-11-21T19:32:54.899ZINFOSledAgent (ServiceManager): Booting oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
13692024-11-21T19:32:54.906ZINFOSledAgent (ServiceManager): Booting oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
13702024-11-21T19:32:54.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 637.710146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
13712024-11-21T19:32:55.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 790.619393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
13722024-11-21T19:32:55.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 59.530749ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
13732024-11-21T19:32:55.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 52.118558ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
13742024-11-21T19:32:55.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 58.679646ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
13752024-11-21T19:32:55.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 54.258814ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
13762024-11-21T19:32:55.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 123.445831ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
13772024-11-21T19:32:55.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 137.90924ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
13782024-11-21T19:32:55.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 217.370723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
13792024-11-21T19:32:55.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 171.75903ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
13802024-11-21T19:32:55.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 1.398181842s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
13812024-11-21T19:32:55.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 166.919738ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
13822024-11-21T19:32:55.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 1.464565644s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
13832024-11-21T19:32:55.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 669.974365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
13842024-11-21T19:32:56.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 446.174387ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
13852024-11-21T19:32:56.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 479.407536ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
13862024-11-21T19:32:56.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 366.371491ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
13872024-11-21T19:32:56.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 1.124214663s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
13882024-11-21T19:32:56.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 680.878797ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
13892024-11-21T19:32:56.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 673.931749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
13902024-11-21T19:32:56.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 556.83491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
13912024-11-21T19:32:56.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 782.447587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
13922024-11-21T19:32:56.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 1.183290081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
13932024-11-21T19:32:56.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 534.194891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
13942024-11-21T19:32:56.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 557.161528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
13952024-11-21T19:32:56.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 938.716385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
13962024-11-21T19:32:56.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 1.030684307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
13972024-11-21T19:32:56.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 1.033739768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
13982024-11-21T19:32:56.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 949.401231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
13992024-11-21T19:32:56.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 589.119661ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
14002024-11-21T19:32:56.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 721.858455ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
14012024-11-21T19:32:56.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 939.125583ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
14022024-11-21T19:32:56.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 1.091772431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
14032024-11-21T19:32:56.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 1.42088348s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
14042024-11-21T19:32:56.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 662.315255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
14052024-11-21T19:32:56.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 1.042466498s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
14062024-11-21T19:32:56.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 1.001494412s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
14072024-11-21T19:32:56.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 568.486763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
14082024-11-21T19:32:57.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 731.13713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
14092024-11-21T19:32:57.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 606.391959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
14102024-11-21T19:32:57.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 1.202511412s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
14112024-11-21T19:32:57.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 1.318812534s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
14122024-11-21T19:32:57.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 595.255514ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
14132024-11-21T19:32:57.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 522.302236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
14142024-11-21T19:32:57.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 1.480495591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
14152024-11-21T19:32:57.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 1.041232694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
14162024-11-21T19:32:57.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 1.390905097s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
14172024-11-21T19:32:57.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 1.100848851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
14182024-11-21T19:32:57.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 1.018864926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
14192024-11-21T19:32:57.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 900.665643ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
14202024-11-21T19:32:57.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 1.044952251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
14212024-11-21T19:32:57.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 1.143922727s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
14222024-11-21T19:32:57.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 1.146580897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
14232024-11-21T19:32:57.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 693.818056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
14242024-11-21T19:32:57.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 799.241552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
14252024-11-21T19:32:57.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 634.913351ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
14262024-11-21T19:32:57.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 1.294329518s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
14272024-11-21T19:32:57.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 922.235034ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
14282024-11-21T19:32:58.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 940.688189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
14292024-11-21T19:32:58.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 930.804423ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
14302024-11-21T19:32:58.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 566.619918ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
14312024-11-21T19:32:58.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 1.234509306s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
14322024-11-21T19:32:58.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 1.227161151s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
14332024-11-21T19:32:58.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 840.440432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
14342024-11-21T19:32:58.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 1.180985766s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
14352024-11-21T19:32:58.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 1.415127729s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
14362024-11-21T19:32:58.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 685.979899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
14372024-11-21T19:32:58.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 1.417869125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
14382024-11-21T19:32:58.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 1.013069179s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
14392024-11-21T19:32:58.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 952.337001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
14402024-11-21T19:32:58.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 762.824052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
14412024-11-21T19:32:58.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 980.544366ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
14422024-11-21T19:32:58.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 834.142486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
14432024-11-21T19:32:58.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 916.142412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
14442024-11-21T19:32:59.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 1.351070295s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
14452024-11-21T19:32:59.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 1.218244779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
14462024-11-21T19:32:59.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 895.704396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
14472024-11-21T19:32:59.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 882.737579ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
14482024-11-21T19:32:59.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 1.143080375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
14492024-11-21T19:32:59.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 983.817453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
14502024-11-21T19:32:59.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 521.15593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
14512024-11-21T19:32:59.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 1.334616665s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
14522024-11-21T19:32:59.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 1.211034115s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
14532024-11-21T19:32:59.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 1.41126296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
14542024-11-21T19:32:59.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 1.174613999s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
14552024-11-21T19:32:59.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 778.653733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
14562024-11-21T19:32:59.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 1.2735001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
14572024-11-21T19:32:59.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 822.621921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
14582024-11-21T19:32:59.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 1.030866156s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
14592024-11-21T19:33:00.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 1.092938595s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
14602024-11-21T19:33:00.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 1.243114989s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
14612024-11-21T19:33:00.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 767.901644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
14622024-11-21T19:33:00.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 1.409817429s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
14632024-11-21T19:33:00.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 1.237290539s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
14642024-11-21T19:33:00.247ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14652024-11-21T19:33:00.247ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
14662024-11-21T19:33:00.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 1.384201829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
14672024-11-21T19:33:00.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 1.043779824s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
14682024-11-21T19:33:00.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 666.870813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
14692024-11-21T19:33:00.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 1.029803248s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
14702024-11-21T19:33:00.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 36.864682ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
14712024-11-21T19:33:00.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 86.029941ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
14722024-11-21T19:33:00.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 1.422533242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
14732024-11-21T19:33:00.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 108.720493ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
14742024-11-21T19:33:00.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 1.341569293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
14752024-11-21T19:33:00.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 515.723045ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
14762024-11-21T19:33:00.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 551.152164ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
14772024-11-21T19:33:00.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 915.961359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
14782024-11-21T19:33:01.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 712.413793ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
14792024-11-21T19:33:01.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 890.695184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
14802024-11-21T19:33:01.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 1.472840116s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
14812024-11-21T19:33:01.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 1.211072865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
14822024-11-21T19:33:01.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 1.431923985s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
14832024-11-21T19:33:01.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 537.993232ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
14842024-11-21T19:33:01.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 1.157691931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
14852024-11-21T19:33:01.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 717.217431ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
14862024-11-21T19:33:01.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 607.980689ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
14872024-11-21T19:33:01.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 1.391226189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
14882024-11-21T19:33:01.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 921.339209ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
14892024-11-21T19:33:01.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 997.844538ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
14902024-11-21T19:33:01.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 783.103712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
14912024-11-21T19:33:01.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 1.256544433s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
14922024-11-21T19:33:01.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 687.333938ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
14932024-11-21T19:33:01.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 506.923225ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
14942024-11-21T19:33:01.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 1.049481414s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
14952024-11-21T19:33:01.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 974.07848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
14962024-11-21T19:33:01.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 872.741493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
14972024-11-21T19:33:02.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 728.133705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
14982024-11-21T19:33:02.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 642.018652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
14992024-11-21T19:33:02.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 1.226740809s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
15002024-11-21T19:33:02.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 1.486318402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
15012024-11-21T19:33:02.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 936.100171ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
15022024-11-21T19:33:02.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 859.773785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
15032024-11-21T19:33:02.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 694.941385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
15042024-11-21T19:33:02.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 1.270233129s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
15052024-11-21T19:33:02.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 1.270045164s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
15062024-11-21T19:33:02.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 1.099982842s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
15072024-11-21T19:33:02.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 922.070254ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
15082024-11-21T19:33:02.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 1.390495507s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
15092024-11-21T19:33:02.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 839.632627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
15102024-11-21T19:33:02.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 1.384389015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
15112024-11-21T19:33:02.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 1.287866682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
15122024-11-21T19:33:02.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 1.369510501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
15132024-11-21T19:33:02.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 941.11694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
15142024-11-21T19:33:02.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 871.297408ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
15152024-11-21T19:33:02.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 1.265659781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
15162024-11-21T19:33:02.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 1.037173192s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
15172024-11-21T19:33:03.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 1.427022157s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
15182024-11-21T19:33:03.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 687.006124ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
15192024-11-21T19:33:03.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 1.17823037s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
15202024-11-21T19:33:03.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 1.403414019s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
15212024-11-21T19:33:03.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 846.84737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
15222024-11-21T19:33:03.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 866.749517ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
15232024-11-21T19:33:03.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 582.715037ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
15242024-11-21T19:33:03.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 957.378247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
15252024-11-21T19:33:03.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 880.188185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
15262024-11-21T19:33:03.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 618.794424ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
15272024-11-21T19:33:03.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 720.455943ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
15282024-11-21T19:33:03.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 1.016886077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
15292024-11-21T19:33:03.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 1.419162449s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
15302024-11-21T19:33:03.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 814.828541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
15312024-11-21T19:33:04.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 1.248680892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
15322024-11-21T19:33:04.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 1.491911156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
15332024-11-21T19:33:04.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 1.103951474s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
15342024-11-21T19:33:04.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 937.658704ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
15352024-11-21T19:33:04.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 1.413227409s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
15362024-11-21T19:33:04.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 1.357692684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
15372024-11-21T19:33:04.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 1.463675437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
15382024-11-21T19:33:04.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 1.261250417s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
15392024-11-21T19:33:04.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 694.963006ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
15402024-11-21T19:33:04.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 1.332793359s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
15412024-11-21T19:33:04.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 1.155292353s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
15422024-11-21T19:33:04.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 1.179491143s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
15432024-11-21T19:33:04.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 889.859068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
15442024-11-21T19:33:04.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 988.067237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
15452024-11-21T19:33:04.681ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15462024-11-21T19:33:04.681ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
15472024-11-21T19:33:04.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 1.194604696s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
15482024-11-21T19:33:04.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 1.348457694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
15492024-11-21T19:33:04.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 1.169459864s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
15502024-11-21T19:33:04.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 40.034009ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
15512024-11-21T19:33:04.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 111.880984ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
15522024-11-21T19:33:05.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 182.789723ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
15532024-11-21T19:33:05.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 754.132758ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
15542024-11-21T19:33:05.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 862.281261ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
15552024-11-21T19:33:05.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 1.336319569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
15562024-11-21T19:33:05.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 744.508349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
15572024-11-21T19:33:05.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 278.4885ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
15582024-11-21T19:33:05.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 851.15723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
15592024-11-21T19:33:05.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 566.650365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
15602024-11-21T19:33:05.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 710.038131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
15612024-11-21T19:33:05.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 1.397385034s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
15622024-11-21T19:33:05.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 649.763572ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
15632024-11-21T19:33:05.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 889.608148ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
15642024-11-21T19:33:05.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 1.239477229s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
15652024-11-21T19:33:05.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 1.225797507s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
15662024-11-21T19:33:05.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 644.42432ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
15672024-11-21T19:33:05.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 731.728123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
15682024-11-21T19:33:05.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 688.367349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
15692024-11-21T19:33:05.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 990.115797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
15702024-11-21T19:33:05.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 563.09169ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
15712024-11-21T19:33:05.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 1.422736045s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
15722024-11-21T19:33:06.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc") failed: Property not found. retry in 854.266012ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
15732024-11-21T19:33:06.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 1.141617909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
15742024-11-21T19:33:06.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 1.467379059s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
15752024-11-21T19:33:06.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 1.425210411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
15762024-11-21T19:33:06.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 676.224734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
15772024-11-21T19:33:06.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 806.060654ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
15782024-11-21T19:33:06.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d") failed: Property not found. retry in 1.387323521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
15792024-11-21T19:33:06.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35") failed: Property not found. retry in 1.328490347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
15802024-11-21T19:33:06.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 569.587137ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
15812024-11-21T19:33:06.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619") failed: Property not found. retry in 990.370788ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
15822024-11-21T19:33:06.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0") failed: Property not found. retry in 1.415888995s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
15832024-11-21T19:33:06.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1") failed: Property not found. retry in 1.442200191s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
15842024-11-21T19:33:06.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 1.409223927s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
15852024-11-21T19:33:06.536ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37120
15862024-11-21T19:33:06.537ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 914 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37120 req_id = 4871ca31-05b1-43bd-8b7b-c90ee33e683d response_code = 200 uri = /baseboard
15872024-11-21T19:33:06.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4") failed: Property not found. retry in 1.450765754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
15882024-11-21T19:33:06.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318") failed: Property not found. retry in 922.202977ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
15892024-11-21T19:33:06.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472") failed: Property not found. retry in 1.384799753s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
15902024-11-21T19:33:06.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 731.291609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
15912024-11-21T19:33:06.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d") failed: Property not found. retry in 762.336107ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
15922024-11-21T19:33:06.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5") failed: Property not found. retry in 1.098040419s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
15932024-11-21T19:33:07.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679") failed: Property not found. retry in 964.633294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
15942024-11-21T19:33:07.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e") failed: Property not found. retry in 1.329667002s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
15952024-11-21T19:33:07.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e") failed: Property not found. retry in 1.415931148s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
15962024-11-21T19:33:07.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 1.029207697s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
15972024-11-21T19:33:07.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c") failed: Property not found. retry in 1.354836793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
15982024-11-21T19:33:07.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20") failed: Property not found. retry in 1.499568153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
15992024-11-21T19:33:07.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb") failed: Property not found. retry in 925.124054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
16002024-11-21T19:33:08.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 1.237321568s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
16012024-11-21T19:33:08.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2") failed: Property not found. retry in 1.382833369s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
16022024-11-21T19:33:09.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 1.494632898s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
16032024-11-21T19:33:10.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 513.400432ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
16042024-11-21T19:33:11.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 1.027093375s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
16052024-11-21T19:33:12.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1") failed: Property not found. retry in 1.337718217s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
16062024-11-21T19:33:13.260ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 42.736109602s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
16072024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_3a5c9363-d084-4653-b4b3-41d106294d20
16082024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_79820cb2-812b-4ec3-9d9d-10275f4f45bb
16092024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_977761ce-56db-4d7f-989a-1753926c4318
16102024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_c5fdcef6-931d-4d38-9395-118db152ff3c
16112024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_0549559a-36c0-43cd-9345-712a6ce4085d
16122024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_796986f8-873c-4bb4-aba3-115f6ba0f472
16132024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_clickhouse_33315960-bb75-402f-b35f-57bf31aa7fa1
16142024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_39d14e41-6d5d-474a-aaea-65c36b8f9da5
16152024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_915e11b8-d7cb-4730-9906-7980540813dc
16162024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_088dbd0f-363c-4785-9d04-aa968256294e
16172024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_5bce18f9-02f8-49f9-ba47-3434651d04e1
16182024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_a9850f8a-24b5-462c-9595-ec017b921a35
16192024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_4e669ff4-6dde-4cd2-8491-623460b56d8d
16202024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_0256a788-b2d9-40a4-a221-ded4046dad4e
16212024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_aca54066-e79b-4cbd-9f73-6d281b0ecad4
16222024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_90b200e8-d1ee-4e0d-975c-64628c5532d2
16232024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_oximeter_5fb99117-c685-44d5-bec2-c58adb63b619
16242024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_a2c5d597-7f38-4da5-8720-0f0a0f767679
16252024-11-21T19:33:13.700ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_d6f3e611-5df4-4398-95ef-e3e39c36b3c0
16262024-11-21T19:33:13.702ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
16272024-11-21T19:33:13.705ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json"
16282024-11-21T19:33:13.705ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
16292024-11-21T19:33:13.707ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json"
16302024-11-21T19:33:13.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37237264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37036 req_id = edeb42c6-8438-43bc-9afc-a3b06f2c2205 response_code = 204 uri = /omicron-zones
16312024-11-21T19:33:13.721ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
16322024-11-21T19:33:13.721ZINFOSledAgent (RSS): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
16332024-11-21T19:33:13.721ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/rss-plan-completed.marker"
16342024-11-21T19:33:13.721ZINFOSledAgent (RSS): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
16352024-11-21T19:33:13.721ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/rss-plan-completed.marker"
16362024-11-21T19:33:13.732ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
16372024-11-21T19:33:13.736ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
16382024-11-21T19:33:13.775ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
16392024-11-21T19:33:13.780ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/6f50eaaf-6509-4592-a570-21594f7b8789/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16402024-11-21T19:33:13.900ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/6f50eaaf-6509-4592-a570-21594f7b8789/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16412024-11-21T19:33:14.070ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/6f50eaaf-6509-4592-a570-21594f7b8789/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16422024-11-21T19:33:14.261ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/6f50eaaf-6509-4592-a570-21594f7b8789/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16432024-11-21T19:33:14.434ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/6f50eaaf-6509-4592-a570-21594f7b8789/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16442024-11-21T19:33:14.700ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/6f50eaaf-6509-4592-a570-21594f7b8789/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16452024-11-21T19:33:16.080ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "78b151af-cb80-45e9-9d21-79c409ff50f4", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"6f50eaaf-6509-4592-a570-21594f7b8789\"", request_id: "78b151af-cb80-45e9-9d21-79c409ff50f4" } file = sled-agent/src/rack_setup/service.rs:1075
16462024-11-21T19:33:16.493ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1c17d68e-8287-4087-accb-7ae0b69df0e2", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"6f50eaaf-6509-4592-a570-21594f7b8789\"", request_id: "1c17d68e-8287-4087-accb-7ae0b69df0e2" } file = sled-agent/src/rack_setup/service.rs:1075
16472024-11-21T19:33:16.822ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cd93405d-d88d-4ca1-bc6e-9d8c0e0751e6", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"6f50eaaf-6509-4592-a570-21594f7b8789\"", request_id: "cd93405d-d88d-4ca1-bc6e-9d8c0e0751e6" } file = sled-agent/src/rack_setup/service.rs:1075
16482024-11-21T19:33:17.122ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1cd454e5-5c4a-4170-94a2-3b9e2c483866", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:17 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"6f50eaaf-6509-4592-a570-21594f7b8789\"", request_id: "1cd454e5-5c4a-4170-94a2-3b9e2c483866" } file = sled-agent/src/rack_setup/service.rs:1075
16492024-11-21T19:33:18.870ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ad46159a-b221-4682-ba86-eaadda1157a7", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"203795ed-576b-40e4-bed8-7463e3f2162c\"", request_id: "ad46159a-b221-4682-ba86-eaadda1157a7" } file = sled-agent/src/rack_setup/service.rs:1075
16502024-11-21T19:33:20.074ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "bdabd3a7-2131-4408-b080-46a3dfa71607", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"203795ed-576b-40e4-bed8-7463e3f2162c\"", request_id: "bdabd3a7-2131-4408-b080-46a3dfa71607" } file = sled-agent/src/rack_setup/service.rs:1075
16512024-11-21T19:33:21.620ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f1d70fcd-3f36-404b-8372-eed14735c9e9", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"203795ed-576b-40e4-bed8-7463e3f2162c\"", request_id: "f1d70fcd-3f36-404b-8372-eed14735c9e9" } file = sled-agent/src/rack_setup/service.rs:1075
16522024-11-21T19:33:22.548ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0ba8df79-3157-4d07-9470-6b32cc5265dc", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"203795ed-576b-40e4-bed8-7463e3f2162c\"", request_id: "0ba8df79-3157-4d07-9470-6b32cc5265dc" } file = sled-agent/src/rack_setup/service.rs:1075
16532024-11-21T19:33:24.055ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "95d5a496-96fb-4e0f-99d2-20499255a41d", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"203795ed-576b-40e4-bed8-7463e3f2162c\"", request_id: "95d5a496-96fb-4e0f-99d2-20499255a41d" } file = sled-agent/src/rack_setup/service.rs:1075
16542024-11-21T19:33:25.554ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2141b5ee-d444-4fc6-9797-4fe5193a5993", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"203795ed-576b-40e4-bed8-7463e3f2162c\"", request_id: "2141b5ee-d444-4fc6-9797-4fe5193a5993" } file = sled-agent/src/rack_setup/service.rs:1075
16552024-11-21T19:33:26.856ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c1764e2f-eb89-42a4-a374-90380a93e4f8", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"203795ed-576b-40e4-bed8-7463e3f2162c\"", request_id: "c1764e2f-eb89-42a4-a374-90380a93e4f8" } file = sled-agent/src/rack_setup/service.rs:1075
16562024-11-21T19:33:28.904ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7da6e098-d480-4f1a-b15c-eb1cc3924f5d", "content-length": "173", "date": "Thu, 21 Nov 2024 19:33:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"203795ed-576b-40e4-bed8-7463e3f2162c\"", request_id: "7da6e098-d480-4f1a-b15c-eb1cc3924f5d" } file = sled-agent/src/rack_setup/service.rs:1075
16572024-11-21T19:33:30.296ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
16582024-11-21T19:33:30.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63647
16592024-11-21T19:33:30.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16602024-11-21T19:33:30.398ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16612024-11-21T19:33:30.398ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json file = common/src/ledger.rs:178
16622024-11-21T19:33:30.399ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json file = common/src/ledger.rs:178
16632024-11-21T19:33:30.414ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16642024-11-21T19:33:30.414ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_11d53b36-56c4-493b-908d-a4b25d43b82e
16652024-11-21T19:33:30.441ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16662024-11-21T19:33:30.441ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789
16672024-11-21T19:33:30.464ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16682024-11-21T19:33:30.464ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_784212b9-62b7-432d-b0d7-e4600fa06921
16692024-11-21T19:33:30.488ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16702024-11-21T19:33:30.488ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_21742b4e-23b7-43df-8530-fcf02dea3824
16712024-11-21T19:33:30.509ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16722024-11-21T19:33:30.509ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0
16732024-11-21T19:33:30.530ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16742024-11-21T19:33:30.531ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_03f27c6c-e171-4450-8876-58f440dc9097
16752024-11-21T19:33:30.552ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16762024-11-21T19:33:30.552ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f
16772024-11-21T19:33:30.573ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16782024-11-21T19:33:30.573ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_695b40ec-ab62-486b-99a5-161c372e3934
16792024-11-21T19:33:30.595ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16802024-11-21T19:33:30.595ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b36cfd4c-887e-4515-9f44-b45436c8de30
16812024-11-21T19:33:30.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216008 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63647 req_id = 8e0315c4-d7e9-4f30-9d76-c97778e1e690 response_code = 200 uri = /inventory
16822024-11-21T19:33:33.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54774
16832024-11-21T19:33:33.036ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16842024-11-21T19:33:33.037ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16852024-11-21T19:33:33.037ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16862024-11-21T19:33:33.037ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16872024-11-21T19:33:33.037ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16882024-11-21T19:33:33.037ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16892024-11-21T19:33:33.037ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16902024-11-21T19:33:33.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4604 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54774 req_id = d71b8fba-e049-4c10-8068-e26bf63565ba response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16912024-11-21T19:33:33.039ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
16922024-11-21T19:33:33.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63435
16932024-11-21T19:33:33.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59386
16942024-11-21T19:33:33.423ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16952024-11-21T19:33:33.423ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16962024-11-21T19:33:33.423ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json file = common/src/ledger.rs:178
16972024-11-21T19:33:33.423ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16982024-11-21T19:33:33.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16992024-11-21T19:33:33.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17002024-11-21T19:33:33.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17012024-11-21T19:33:33.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17022024-11-21T19:33:33.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17032024-11-21T19:33:33.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17042024-11-21T19:33:33.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63435 req_id = fbca5efd-0fc5-4ba6-bf72-235be2c9da02 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17052024-11-21T19:33:33.424ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json file = common/src/ledger.rs:178
17062024-11-21T19:33:33.437ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17072024-11-21T19:33:33.437ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_11d53b36-56c4-493b-908d-a4b25d43b82e
17082024-11-21T19:33:33.462ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17092024-11-21T19:33:33.462ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789
17102024-11-21T19:33:33.486ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17112024-11-21T19:33:33.486ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_784212b9-62b7-432d-b0d7-e4600fa06921
17122024-11-21T19:33:33.511ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17132024-11-21T19:33:33.511ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_21742b4e-23b7-43df-8530-fcf02dea3824
17142024-11-21T19:33:33.532ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17152024-11-21T19:33:33.532ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0
17162024-11-21T19:33:33.555ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17172024-11-21T19:33:33.555ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_03f27c6c-e171-4450-8876-58f440dc9097
17182024-11-21T19:33:33.576ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17192024-11-21T19:33:33.576ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f
17202024-11-21T19:33:33.598ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17212024-11-21T19:33:33.598ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_695b40ec-ab62-486b-99a5-161c372e3934
17222024-11-21T19:33:33.620ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17232024-11-21T19:33:33.620ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b36cfd4c-887e-4515-9f44-b45436c8de30
17242024-11-21T19:33:33.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211725 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59386 req_id = d5218baf-8781-4138-995b-b728c0e0a8af response_code = 200 uri = /inventory
17252024-11-21T19:33:33.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65244
17262024-11-21T19:33:33.733ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17272024-11-21T19:33:33.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17282024-11-21T19:33:33.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17292024-11-21T19:33:33.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17302024-11-21T19:33:33.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17312024-11-21T19:33:33.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17322024-11-21T19:33:33.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17332024-11-21T19:33:33.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 846 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65244 req_id = baedcceb-3b47-453a-91a7-c1fa3cec1b51 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17342024-11-21T19:33:34.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55381
17352024-11-21T19:33:34.299ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17362024-11-21T19:33:34.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17372024-11-21T19:33:34.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17382024-11-21T19:33:34.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17392024-11-21T19:33:34.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17402024-11-21T19:33:34.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17412024-11-21T19:33:34.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17422024-11-21T19:33:34.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55381 req_id = 60189648-e862-4d87-8536-fe9122d2b892 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17432024-11-21T19:33:36.595ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38112
17442024-11-21T19:33:36.595ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38112 req_id = 81891e2e-c95f-4954-bb15-2994de61242f response_code = 200 uri = /baseboard
17452024-11-21T19:33:44.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57162
17462024-11-21T19:33:44.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57162 req_id = e5f9b533-76cb-4d82-b718-8a86bd3d6c8f response_code = 200 uri = /vpc-routes
17472024-11-21T19:33:44.206ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
17482024-11-21T19:33:44.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 449 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57162 req_id = 2506702d-9325-44f0-8292-bb786b0ab1cc response_code = 204 uri = /eip-gateways
17492024-11-21T19:33:44.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57162 req_id = d1387c91-d5e1-4625-9081-326111ce61aa response_code = 204 uri = /vpc-routes
17502024-11-21T19:33:47.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58468
17512024-11-21T19:33:47.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58468 req_id = 00a8b29a-9812-4543-bc57-1827e050adce response_code = 200 uri = /vpc-routes
17522024-11-21T19:33:47.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48245
17532024-11-21T19:33:47.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48245 req_id = 27cb3e6b-4813-400e-b6be-64cbca828324 response_code = 200 uri = /vpc-routes
17542024-11-21T19:33:47.864ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
17552024-11-21T19:33:47.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58468 req_id = c1e18363-90ab-47c4-9c39-22aec73c1827 response_code = 204 uri = /eip-gateways
17562024-11-21T19:33:47.904ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
17572024-11-21T19:33:47.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48245 req_id = 4d303b32-618d-4cc0-87e6-ed41171cbb72 response_code = 204 uri = /eip-gateways
17582024-11-21T19:33:47.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48206
17592024-11-21T19:33:47.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 446 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48206 req_id = f803beaf-7ae9-4af1-b6f7-dbdf02f23d41 response_code = 200 uri = /v2p
17602024-11-21T19:33:47.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58468 req_id = 8005e7f0-a83e-48d9-8472-53d0688d990f response_code = 204 uri = /vpc-routes
17612024-11-21T19:33:47.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57195
17622024-11-21T19:33:47.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57195 req_id = bf2879dd-f35a-48c5-a75c-3cd47b711ba8 response_code = 200 uri = /v2p
17632024-11-21T19:33:47.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48245 req_id = f3bd8685-a09e-4bbd-bff4-2fa8725ba9f6 response_code = 204 uri = /vpc-routes
17642024-11-21T19:33:48.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62286
17652024-11-21T19:33:48.026ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
17662024-11-21T19:33:48.144ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
17672024-11-21T19:33:48.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186112 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62286 req_id = fd291bc7-b843-4ae1-b9f0-4e6e5bf28b86 response_code = 204 uri = /switch-ports
17682024-11-21T19:33:48.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56454
17692024-11-21T19:33:48.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35435
17702024-11-21T19:33:48.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46083
17712024-11-21T19:33:48.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46083 req_id = 335c915e-a956-4f60-9c55-76c4b4998e2d response_code = 200 uri = /v2p
17722024-11-21T19:33:48.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
17732024-11-21T19:33:48.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14424 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62286 req_id = 77c5d172-4cb4-4675-bdec-f0a13e31a21a response_code = 200 uri = /network-bootstore-config
17742024-11-21T19:33:48.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56454 req_id = 89a2667d-defb-4fdf-8cb3-810efe5b3e4a response_code = 200 uri = /vpc-routes
17752024-11-21T19:33:48.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57019
17762024-11-21T19:33:48.273ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
17772024-11-21T19:33:48.283ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
17782024-11-21T19:33:48.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56454 req_id = 82631978-904a-4f35-8f69-815ffc941343 response_code = 204 uri = /eip-gateways
17792024-11-21T19:33:48.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 861 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56454 req_id = 6aeaf807-467c-4aad-b50c-f9ab13b5ca28 response_code = 204 uri = /vpc-routes
17802024-11-21T19:33:48.305ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17812024-11-21T19:33:48.305ZINFOSledAgent (bootstore): Writing ledger to /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
17822024-11-21T19:33:48.307ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
17832024-11-21T19:33:48.307ZINFOSledAgent (bootstore): Writing ledger to /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
17842024-11-21T19:33:48.308ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
17852024-11-21T19:33:48.308ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17862024-11-21T19:33:48.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7526 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62286 req_id = ac57a782-982b-4b8f-86a1-a59d73d8489c response_code = 204 uri = /network-bootstore-config
17872024-11-21T19:33:48.362ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
17882024-11-21T19:33:48.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153813 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35435 req_id = 8050c7f5-e19c-42c9-9edf-c4a419de9c65 response_code = 204 uri = /switch-ports
17892024-11-21T19:33:48.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 726 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35435 req_id = 6688cfb3-a34a-459b-8c0f-49a873124d6d response_code = 200 uri = /network-bootstore-config
17902024-11-21T19:33:48.398ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
17912024-11-21T19:33:48.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57019 req_id = bcd171f6-76c0-4b64-9e78-5dae388eacd0 response_code = 204 uri = /switch-ports
17922024-11-21T19:33:48.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57019 req_id = 5fdc030f-2d39-4799-8f47-c3016e6ac448 response_code = 200 uri = /network-bootstore-config
17932024-11-21T19:34:02.077ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:46831 remote_addr = [fd00:1122:3344:101::d]:39865 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
17942024-11-21T19:34:02.116ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38322 local_addr = [fd00:1122:3344:101::1]:46831 method = GET remote_addr = [fd00:1122:3344:101::d]:39865 req_id = 1bdea111-059c-4ada-9372-81b9f8f0df92 response_code = 200 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c uri = /203795ed-576b-40e4-bed8-7463e3f2162c
17952024-11-21T19:34:06.628ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37285
17962024-11-21T19:34:06.629ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37285 req_id = 9f5234f5-0944-408b-af51-5b163a016e39 response_code = 200 uri = /baseboard
17972024-11-21T19:34:17.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63212
17982024-11-21T19:34:17.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63212 req_id = df633770-18c2-4c4f-b402-1a5d8c9236f5 response_code = 200 uri = /vpc-routes
17992024-11-21T19:34:17.911ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
18002024-11-21T19:34:17.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63212 req_id = 970cf438-f3ae-4c80-b523-51298a563491 response_code = 204 uri = /eip-gateways
18012024-11-21T19:34:17.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63212 req_id = bf467218-cd87-42cc-956e-8f08d5393d73 response_code = 204 uri = /vpc-routes
18022024-11-21T19:34:18.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34832
18032024-11-21T19:34:18.022ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18042024-11-21T19:34:18.070ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18052024-11-21T19:34:18.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34832 req_id = 4ccc6070-fc9b-4417-9d02-ef436ebcf760 response_code = 204 uri = /switch-ports
18062024-11-21T19:34:18.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54388
18072024-11-21T19:34:18.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48957
18082024-11-21T19:34:18.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48957 req_id = 0150b582-8c7e-4b6f-90c5-0aef315a1a27 response_code = 200 uri = /vpc-routes
18092024-11-21T19:34:18.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34832 req_id = 168bc935-d4dc-49ac-9119-494bedea79d6 response_code = 200 uri = /network-bootstore-config
18102024-11-21T19:34:18.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54388 req_id = 76fd80fd-60c9-414e-b140-64578a2db408 response_code = 200 uri = /v2p
18112024-11-21T19:34:18.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34486
18122024-11-21T19:34:18.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18132024-11-21T19:34:18.185ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18142024-11-21T19:34:18.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34486 req_id = 43fd356a-7e4e-45c1-be3d-a35379c4aedd response_code = 204 uri = /switch-ports
18152024-11-21T19:34:18.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63286
18162024-11-21T19:34:18.251ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
18172024-11-21T19:34:18.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48957 req_id = 82be53cf-e962-476d-bfd6-63fe11e92332 response_code = 204 uri = /eip-gateways
18182024-11-21T19:34:18.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34486 req_id = 34b0963a-d356-419d-a965-1d3168e1553d response_code = 200 uri = /network-bootstore-config
18192024-11-21T19:34:18.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63286 req_id = 62d75621-9eaa-497c-8ce0-841d2bcb08fa response_code = 200 uri = /v2p
18202024-11-21T19:34:18.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63708
18212024-11-21T19:34:18.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63708 req_id = afbcdda5-e905-4aec-a5a4-9008ad157414 response_code = 200 uri = /vpc-routes
18222024-11-21T19:34:18.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48957 req_id = afc7c101-0a81-4550-9f76-77611c7d6523 response_code = 204 uri = /vpc-routes
18232024-11-21T19:34:18.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56014
18242024-11-21T19:34:18.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56014 req_id = cdb3b10e-473c-46b8-a0ac-1ed07ac17beb response_code = 200 uri = /v2p
18252024-11-21T19:34:18.299ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
18262024-11-21T19:34:18.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63708 req_id = 2011b11e-d4e2-43d0-ba97-6fbe89890dfe response_code = 204 uri = /eip-gateways
18272024-11-21T19:34:18.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63708 req_id = cf01e285-4b46-4030-bb78-646fc2e45ff6 response_code = 204 uri = /vpc-routes
18282024-11-21T19:34:18.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61632
18292024-11-21T19:34:18.392ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18302024-11-21T19:34:18.430ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18312024-11-21T19:34:18.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94052 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61632 req_id = 62daf209-b2ad-449c-aff5-48e558d7b195 response_code = 204 uri = /switch-ports
18322024-11-21T19:34:18.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61632 req_id = 05f40110-30b6-46c0-a351-39ac81651d48 response_code = 200 uri = /network-bootstore-config
18332024-11-21T19:34:36.661ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47762
18342024-11-21T19:34:36.661ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47762 req_id = dff87825-4cdb-469d-bbfa-604c6515807f response_code = 200 uri = /baseboard
18352024-11-21T19:34:47.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40526
18362024-11-21T19:34:47.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40526 req_id = abd814f6-53f0-4103-acc1-002ed5029aef response_code = 200 uri = /vpc-routes
18372024-11-21T19:34:47.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44960
18382024-11-21T19:34:47.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44960 req_id = 1d816fc0-85da-43dc-8a6b-e89c75f07377 response_code = 200 uri = /vpc-routes
18392024-11-21T19:34:47.856ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
18402024-11-21T19:34:47.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44960 req_id = 82c2ed4a-534d-4e87-b7c2-c32e258083c4 response_code = 204 uri = /eip-gateways
18412024-11-21T19:34:47.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
18422024-11-21T19:34:47.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40526 req_id = cfe1e484-8074-4520-929e-28f9f163a473 response_code = 204 uri = /eip-gateways
18432024-11-21T19:34:47.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44960 req_id = 4ff53714-d54f-47c7-bbc1-a2f7ee2a2f38 response_code = 204 uri = /vpc-routes
18442024-11-21T19:34:47.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40526 req_id = 7a5114e1-045f-44ad-a24f-8bde86b92ede response_code = 204 uri = /vpc-routes
18452024-11-21T19:34:47.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51661
18462024-11-21T19:34:47.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51661 req_id = 00410119-1c6c-4835-a270-3d446cd74f70 response_code = 200 uri = /v2p
18472024-11-21T19:34:47.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57458
18482024-11-21T19:34:47.929ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18492024-11-21T19:34:47.975ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18502024-11-21T19:34:48.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110097 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57458 req_id = a0427dd5-7c35-4819-9785-4a7aa362f5f2 response_code = 204 uri = /switch-ports
18512024-11-21T19:34:48.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43578
18522024-11-21T19:34:48.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52065
18532024-11-21T19:34:48.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18542024-11-21T19:34:48.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52065 req_id = 8bdc86c4-2bf5-4f91-8236-8a190046984c response_code = 200 uri = /vpc-routes
18552024-11-21T19:34:48.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57458 req_id = c34d19e9-321a-4e29-9531-d252384cb0dc response_code = 200 uri = /network-bootstore-config
18562024-11-21T19:34:48.056ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
18572024-11-21T19:34:48.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52065 req_id = 8e1fb530-8c5d-4ebd-8e07-8a4b4d26a1c5 response_code = 204 uri = /eip-gateways
18582024-11-21T19:34:48.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61695
18592024-11-21T19:34:48.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61695 req_id = 22760ffe-7172-47b4-8f58-9d152f112c62 response_code = 200 uri = /v2p
18602024-11-21T19:34:48.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18612024-11-21T19:34:48.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37998
18622024-11-21T19:34:48.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37998 req_id = 1396a448-fd5b-42a0-9235-f400859bd0c7 response_code = 200 uri = /v2p
18632024-11-21T19:34:48.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52065 req_id = 259659ff-7707-404c-9735-3a35501782ca response_code = 204 uri = /vpc-routes
18642024-11-21T19:34:48.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54028
18652024-11-21T19:34:48.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43578 req_id = 2470b283-0be5-40f7-9fd2-baa4675bff2c response_code = 204 uri = /switch-ports
18662024-11-21T19:34:48.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18672024-11-21T19:34:48.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43578 req_id = e639625d-94fb-4068-a28b-e41dd3a54ce8 response_code = 200 uri = /network-bootstore-config
18682024-11-21T19:34:48.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18692024-11-21T19:34:48.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92268 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54028 req_id = f3ac6906-e71f-4075-8607-62b5be5aec9c response_code = 204 uri = /switch-ports
18702024-11-21T19:34:48.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54028 req_id = ceb0ebdc-0b8b-48b4-a08f-c6cb462b2142 response_code = 200 uri = /network-bootstore-config
18712024-11-21T19:34:57.479ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18722024-11-21T19:35:06.696ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49791
18732024-11-21T19:35:06.696ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49791 req_id = f1f2dea6-35af-4807-b8e5-acd58721532c response_code = 200 uri = /baseboard
18742024-11-21T19:35:17.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48522
18752024-11-21T19:35:17.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48522 req_id = 62cf5745-029b-4e2e-b29c-66636be8effb response_code = 200 uri = /vpc-routes
18762024-11-21T19:35:17.842ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
18772024-11-21T19:35:17.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48522 req_id = 85ba3367-93cc-4b98-bf64-fd99a572c3f6 response_code = 204 uri = /eip-gateways
18782024-11-21T19:35:17.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48522 req_id = 23c41478-bb45-447c-bfb7-51b453245b98 response_code = 204 uri = /vpc-routes
18792024-11-21T19:35:17.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56904
18802024-11-21T19:35:17.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56904 req_id = a4fd7be7-708e-4321-9066-a64bd926bfff response_code = 200 uri = /vpc-routes
18812024-11-21T19:35:18.032ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
18822024-11-21T19:35:18.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56904 req_id = 3aaef110-3470-4eb2-8496-d72852e2e46f response_code = 204 uri = /eip-gateways
18832024-11-21T19:35:18.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56904 req_id = cd369bb8-6ef9-437c-8087-681fb465ed96 response_code = 204 uri = /vpc-routes
18842024-11-21T19:35:18.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44645
18852024-11-21T19:35:18.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44645 req_id = ad3b0da9-f211-4914-80ab-8173d7908271 response_code = 200 uri = /vpc-routes
18862024-11-21T19:35:18.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57658
18872024-11-21T19:35:18.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57658 req_id = cc06bc27-9d52-4d92-a6b3-a12572aeb39a response_code = 200 uri = /v2p
18882024-11-21T19:35:18.124ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
18892024-11-21T19:35:18.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44645 req_id = c01b6196-e9e9-4847-bb55-d59858b28db2 response_code = 204 uri = /eip-gateways
18902024-11-21T19:35:18.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44645 req_id = 7f6f44c7-b06f-4419-b73a-c484960a114a response_code = 204 uri = /vpc-routes
18912024-11-21T19:35:18.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33692
18922024-11-21T19:35:18.238ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18932024-11-21T19:35:18.274ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18942024-11-21T19:35:18.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94823 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33692 req_id = a99686d9-ff9d-414b-863e-31ee2335d534 response_code = 204 uri = /switch-ports
18952024-11-21T19:35:18.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45856
18962024-11-21T19:35:18.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35598
18972024-11-21T19:35:18.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45856 req_id = 87b2a5e0-262e-402d-a76a-d7bad0c745f8 response_code = 200 uri = /v2p
18982024-11-21T19:35:18.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33692 req_id = 06b857b4-a41c-4fdd-93bf-621e00eb192b response_code = 200 uri = /network-bootstore-config
18992024-11-21T19:35:18.334ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19002024-11-21T19:35:18.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42954
19012024-11-21T19:35:18.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42954 req_id = 181bceab-b6d1-4f4a-9500-da812af6a055 response_code = 200 uri = /v2p
19022024-11-21T19:35:18.371ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19032024-11-21T19:35:18.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57640
19042024-11-21T19:35:18.425ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19052024-11-21T19:35:18.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35598 req_id = 1396f603-5019-4d74-a0c1-a861ae1ecb7c response_code = 204 uri = /switch-ports
19062024-11-21T19:35:18.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 756 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35598 req_id = 84794ddd-5ddf-48d1-8bc6-b7da6b42635b response_code = 200 uri = /network-bootstore-config
19072024-11-21T19:35:18.461ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19082024-11-21T19:35:18.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57640 req_id = 2ca825a2-8fb7-42b5-83bb-f7ca1fa88abb response_code = 204 uri = /switch-ports
19092024-11-21T19:35:18.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57640 req_id = 11572398-9b9f-4189-9154-fd23c279313a response_code = 200 uri = /network-bootstore-config
19102024-11-21T19:35:36.737ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54203
19112024-11-21T19:35:36.737ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54203 req_id = b067fee8-5ee5-43d0-a10f-7e6eaeacc215 response_code = 200 uri = /baseboard
19122024-11-21T19:35:47.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41175
19132024-11-21T19:35:47.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41175 req_id = 73c3ebdd-ec2a-4102-bb98-377961673c8b response_code = 200 uri = /vpc-routes
19142024-11-21T19:35:47.818ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
19152024-11-21T19:35:47.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41175 req_id = bd82818e-6d80-4d5c-a427-f7aa45d060a7 response_code = 204 uri = /eip-gateways
19162024-11-21T19:35:47.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41175 req_id = fe154cd5-a881-40b9-a34e-4e935fd61ed7 response_code = 204 uri = /vpc-routes
19172024-11-21T19:35:47.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38336
19182024-11-21T19:35:47.877ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19192024-11-21T19:35:47.925ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19202024-11-21T19:35:47.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110319 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38336 req_id = 387a952a-1c31-4740-a4eb-171afbe309d2 response_code = 204 uri = /switch-ports
19212024-11-21T19:35:47.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41503
19222024-11-21T19:35:47.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33930
19232024-11-21T19:35:47.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34117
19242024-11-21T19:35:47.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43887
19252024-11-21T19:35:47.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38336 req_id = edea7909-9cc9-40b7-9353-5ddd10212acf response_code = 200 uri = /network-bootstore-config
19262024-11-21T19:35:47.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41503 req_id = 4f9dbee0-4ea4-47f1-ad93-54e28e4ed0a1 response_code = 200 uri = /vpc-routes
19272024-11-21T19:35:47.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43887 req_id = 08473d61-0cf0-446e-860c-f7307b81e5cd response_code = 200 uri = /v2p
19282024-11-21T19:35:47.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33930 req_id = d440413a-006d-4fd1-b1d0-60a85370d290 response_code = 200 uri = /v2p
19292024-11-21T19:35:47.988ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19302024-11-21T19:35:48.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56343
19312024-11-21T19:35:48.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56343 req_id = 99684b69-bf6f-4d23-96c8-682a65405b75 response_code = 200 uri = /vpc-routes
19322024-11-21T19:35:48.026ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19332024-11-21T19:35:48.030ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
19342024-11-21T19:35:48.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56343 req_id = 1f25bdf9-b3d4-4dff-b409-840ebea85fb4 response_code = 204 uri = /eip-gateways
19352024-11-21T19:35:48.030ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
19362024-11-21T19:35:48.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41503 req_id = 9c3dd616-d7b6-410c-a4f7-9336831e05be response_code = 204 uri = /eip-gateways
19372024-11-21T19:35:48.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3887 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56343 req_id = 6f069631-b05f-4170-9430-8bb8c370e034 response_code = 204 uri = /vpc-routes
19382024-11-21T19:35:48.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41503 req_id = 53460144-1ef6-478b-a594-ecd3349c995f response_code = 204 uri = /vpc-routes
19392024-11-21T19:35:48.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98827 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34117 req_id = 7757bf05-9a44-46e8-9ad8-5288fcfe0c51 response_code = 204 uri = /switch-ports
19402024-11-21T19:35:48.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34117 req_id = 13998545-659b-4050-969b-9e9b539cc742 response_code = 200 uri = /network-bootstore-config
19412024-11-21T19:35:48.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37332
19422024-11-21T19:35:48.141ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19432024-11-21T19:35:48.178ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19442024-11-21T19:35:48.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94201 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37332 req_id = eaa30900-fd65-4780-86ad-857dece1d442 response_code = 204 uri = /switch-ports
19452024-11-21T19:35:48.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34487
19462024-11-21T19:35:48.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34487 req_id = 19c07d1e-3792-40ec-9298-6e9dd44b7b3c response_code = 200 uri = /v2p
19472024-11-21T19:35:48.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37332 req_id = 0529c9ca-7c06-40d8-9c65-0bfa37dbfe6e response_code = 200 uri = /network-bootstore-config
19482024-11-21T19:36:06.772ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41350
19492024-11-21T19:36:06.773ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41350 req_id = 3051a18b-02d0-4abc-a858-7199cd7ddcce response_code = 200 uri = /baseboard
19502024-11-21T19:36:18.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39921
19512024-11-21T19:36:18.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39921 req_id = c36d5c2b-e571-4f08-bb09-19259fa08556 response_code = 200 uri = /vpc-routes
19522024-11-21T19:36:18.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55322
19532024-11-21T19:36:18.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55322 req_id = abcdbf3f-415d-4663-ad84-bcd7e3374d4b response_code = 200 uri = /v2p
19542024-11-21T19:36:18.150ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
19552024-11-21T19:36:18.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39921 req_id = 29007d32-fc96-4a14-a2dd-a8ecb6aa1d3f response_code = 204 uri = /eip-gateways
19562024-11-21T19:36:18.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39921 req_id = dcf0ae50-9930-4032-98b0-ab65494e2e6e response_code = 204 uri = /vpc-routes
19572024-11-21T19:36:18.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62238
19582024-11-21T19:36:18.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19592024-11-21T19:36:18.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19602024-11-21T19:36:18.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91000 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62238 req_id = bd884701-2c05-410b-8e82-5a8ac3387789 response_code = 204 uri = /switch-ports
19612024-11-21T19:36:18.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62238 req_id = 1facfd62-8d87-4c12-8815-b8227bb8b9dd response_code = 200 uri = /network-bootstore-config
19622024-11-21T19:36:18.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52787
19632024-11-21T19:36:18.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52787 req_id = 38d8ddcd-d954-4dce-859f-c689a91c0752 response_code = 200 uri = /v2p
19642024-11-21T19:36:18.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51339
19652024-11-21T19:36:18.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51339 req_id = c434e2ab-38b3-43a5-9549-a0faf1cb5979 response_code = 200 uri = /vpc-routes
19662024-11-21T19:36:18.285ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
19672024-11-21T19:36:18.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51339 req_id = 681b5d38-3be4-4466-ba83-89c8118cb7ae response_code = 204 uri = /eip-gateways
19682024-11-21T19:36:18.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51339 req_id = 1e58373d-66e5-4349-842c-422102e1eb10 response_code = 204 uri = /vpc-routes
19692024-11-21T19:36:18.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53486
19702024-11-21T19:36:18.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53486 req_id = c1d71578-b1d3-4a90-857a-e318d6c4e4bb response_code = 200 uri = /vpc-routes
19712024-11-21T19:36:18.322ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
19722024-11-21T19:36:18.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53486 req_id = 848a49a9-4eea-4bb7-b2ac-b204b7cf37a2 response_code = 204 uri = /eip-gateways
19732024-11-21T19:36:18.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53486 req_id = 84e72b7d-b2a4-46c9-846d-6bf750044af0 response_code = 204 uri = /vpc-routes
19742024-11-21T19:36:18.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60589
19752024-11-21T19:36:18.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60589 req_id = 01b66705-5eb3-4ace-91e7-eb48541b14f1 response_code = 200 uri = /v2p
19762024-11-21T19:36:18.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53253
19772024-11-21T19:36:18.423ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19782024-11-21T19:36:18.455ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19792024-11-21T19:36:18.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79545 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53253 req_id = 1897d55e-b3c6-4d47-b1c5-b3d4ecad1dd6 response_code = 204 uri = /switch-ports
19802024-11-21T19:36:18.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39459
19812024-11-21T19:36:18.503ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19822024-11-21T19:36:18.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53253 req_id = 165bcddb-cc1d-4a1a-a4b2-6c1e24cce51c response_code = 200 uri = /network-bootstore-config
19832024-11-21T19:36:18.541ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19842024-11-21T19:36:18.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88152 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39459 req_id = cd983b72-692b-49dc-bb3b-0807e3a3f6e2 response_code = 204 uri = /switch-ports
19852024-11-21T19:36:18.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39459 req_id = fe7f9004-44bf-4898-811e-7e90a806186f response_code = 200 uri = /network-bootstore-config
19862024-11-21T19:36:36.807ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44456
19872024-11-21T19:36:36.808ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44456 req_id = 14861632-52b8-4c5d-a8ef-8ee51d3100d2 response_code = 200 uri = /baseboard
19882024-11-21T19:36:47.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57010
19892024-11-21T19:36:47.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57010 req_id = 44b671df-c775-4f25-a436-102ca0e39c3e response_code = 200 uri = /vpc-routes
19902024-11-21T19:36:47.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33718
19912024-11-21T19:36:47.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33718 req_id = 08e36a47-d63c-469c-ad9c-61dcffcfa571 response_code = 200 uri = /vpc-routes
19922024-11-21T19:36:47.909ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
19932024-11-21T19:36:47.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57010 req_id = b0c4f34e-d3da-4aec-8db6-85a8108ca291 response_code = 204 uri = /eip-gateways
19942024-11-21T19:36:47.920ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
19952024-11-21T19:36:47.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33718 req_id = fd0d4b35-a2eb-45d4-a93b-1d37dec070eb response_code = 204 uri = /eip-gateways
19962024-11-21T19:36:47.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57010 req_id = 891acff8-108f-4b7c-87bc-e3feecd8841f response_code = 204 uri = /vpc-routes
19972024-11-21T19:36:47.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63650
19982024-11-21T19:36:47.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63650 req_id = 8a6eead8-6047-44c7-9756-28e4e8567b04 response_code = 200 uri = /v2p
19992024-11-21T19:36:47.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33718 req_id = c3f2490c-0068-43af-91b9-108d983743b4 response_code = 204 uri = /vpc-routes
20002024-11-21T19:36:47.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43432
20012024-11-21T19:36:47.984ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20022024-11-21T19:36:48.024ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20032024-11-21T19:36:48.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97997 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43432 req_id = 805ff033-1b2c-418c-b66d-c42835be1e10 response_code = 204 uri = /switch-ports
20042024-11-21T19:36:48.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63976
20052024-11-21T19:36:48.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48108
20062024-11-21T19:36:48.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47176
20072024-11-21T19:36:48.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43432 req_id = 26acff0e-0271-4d4f-aa74-d79be33b21db response_code = 200 uri = /network-bootstore-config
20082024-11-21T19:36:48.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47176 req_id = f13bf7a8-6d95-4162-b7ed-8782ea4de0a8 response_code = 200 uri = /vpc-routes
20092024-11-21T19:36:48.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63976 req_id = 37fa7a5c-3c4c-4b6c-9b8d-c96d199e9a2e response_code = 200 uri = /v2p
20102024-11-21T19:36:48.083ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20112024-11-21T19:36:48.098ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
20122024-11-21T19:36:48.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47176 req_id = e7253111-4bf4-42f1-a1fc-4bc566fb5138 response_code = 204 uri = /eip-gateways
20132024-11-21T19:36:48.123ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20142024-11-21T19:36:48.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61723
20152024-11-21T19:36:48.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61723 req_id = 7b8ad81d-eace-4c59-9ca7-eaecde6d22e4 response_code = 200 uri = /v2p
20162024-11-21T19:36:48.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47176 req_id = c59edc51-c775-4247-ae06-88747ee77262 response_code = 204 uri = /vpc-routes
20172024-11-21T19:36:48.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93330 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48108 req_id = 680a304a-3a5b-4af8-9f8c-b509698df05d response_code = 204 uri = /switch-ports
20182024-11-21T19:36:48.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48108 req_id = 1e8dbc3b-1420-4d08-85f0-7e1e1ae57a1f response_code = 200 uri = /network-bootstore-config
20192024-11-21T19:36:48.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41366
20202024-11-21T19:36:48.199ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20212024-11-21T19:36:48.235ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20222024-11-21T19:36:48.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91350 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41366 req_id = e4653ae2-6e5a-4595-b917-19a9cdf8da5d response_code = 204 uri = /switch-ports
20232024-11-21T19:36:48.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41366 req_id = df7e3ef3-3338-4e0d-b0fe-752a727fe9f3 response_code = 200 uri = /network-bootstore-config
20242024-11-21T19:37:06.842ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34735
20252024-11-21T19:37:06.843ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34735 req_id = 9e858c9c-4570-4cc0-be2e-2f7dace079ad response_code = 200 uri = /baseboard
20262024-11-21T19:37:17.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58373
20272024-11-21T19:37:17.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58373 req_id = 3eb24428-3a48-4e83-9287-eb0752bd98eb response_code = 200 uri = /vpc-routes
20282024-11-21T19:37:17.946ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
20292024-11-21T19:37:17.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58373 req_id = eadee3ac-9dea-4b7b-8b62-20a82c43cc20 response_code = 204 uri = /eip-gateways
20302024-11-21T19:37:17.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53987
20312024-11-21T19:37:17.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53987 req_id = e0a4bc7e-3981-4cd5-ae50-7aef320a8027 response_code = 200 uri = /vpc-routes
20322024-11-21T19:37:17.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58373 req_id = b47ce726-14b7-4cc9-8fe3-3627d7fb942a response_code = 204 uri = /vpc-routes
20332024-11-21T19:37:18.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
20342024-11-21T19:37:18.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53987 req_id = d31c98a7-ca2d-4290-b1dc-34fdf43c8072 response_code = 204 uri = /eip-gateways
20352024-11-21T19:37:18.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33878
20362024-11-21T19:37:18.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33878 req_id = 3ee5c866-92be-4a5c-b714-609728ff4565 response_code = 200 uri = /v2p
20372024-11-21T19:37:18.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53987 req_id = f0735d91-390d-447e-bf51-ee3d535f5397 response_code = 204 uri = /vpc-routes
20382024-11-21T19:37:18.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49266
20392024-11-21T19:37:18.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20402024-11-21T19:37:18.156ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20412024-11-21T19:37:18.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98674 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49266 req_id = 37dafff0-d2f9-4b4a-b3fb-9125d1002183 response_code = 204 uri = /switch-ports
20422024-11-21T19:37:18.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48457
20432024-11-21T19:37:18.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45592
20442024-11-21T19:37:18.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59738
20452024-11-21T19:37:18.215ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20462024-11-21T19:37:18.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3783 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49266 req_id = 890b811c-7b5e-480d-82a9-a5a91342f4f0 response_code = 200 uri = /network-bootstore-config
20472024-11-21T19:37:18.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3983 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48457 req_id = 9c46e984-ac17-4dd6-b090-cf0ddcbc35ee response_code = 200 uri = /v2p
20482024-11-21T19:37:18.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3985 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45592 req_id = ed61fa50-4f71-47d1-bb9a-1e5774b50a6d response_code = 200 uri = /vpc-routes
20492024-11-21T19:37:18.234ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
20502024-11-21T19:37:18.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45592 req_id = d5b5d5e2-c6ef-44de-bb7f-764c530baf17 response_code = 204 uri = /eip-gateways
20512024-11-21T19:37:18.251ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20522024-11-21T19:37:18.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50903
20532024-11-21T19:37:18.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50903 req_id = c64e103f-3ffa-44af-928c-6e97693655d0 response_code = 200 uri = /v2p
20542024-11-21T19:37:18.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 588 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45592 req_id = 7721ba25-27a0-4380-b243-cad30dde97cc response_code = 204 uri = /vpc-routes
20552024-11-21T19:37:18.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59738 req_id = 09e766df-391d-4e6c-8243-1d934a88c177 response_code = 204 uri = /switch-ports
20562024-11-21T19:37:18.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59738 req_id = 0fdb2393-3edc-4cda-97e6-b6dc28f7b4a9 response_code = 200 uri = /network-bootstore-config
20572024-11-21T19:37:18.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58683
20582024-11-21T19:37:18.375ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20592024-11-21T19:37:18.410ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20602024-11-21T19:37:18.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58683 req_id = 9f2fb5f7-7a90-484b-a3ec-3cece231fa49 response_code = 204 uri = /switch-ports
20612024-11-21T19:37:18.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58683 req_id = 9d8b3458-ce4a-42ae-badd-e3c2b376f0b5 response_code = 200 uri = /network-bootstore-config
20622024-11-21T19:37:36.877ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56319
20632024-11-21T19:37:36.878ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56319 req_id = ce5ccde7-d7da-4aa0-9bfb-66967477c218 response_code = 200 uri = /baseboard
20642024-11-21T19:37:47.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54849
20652024-11-21T19:37:47.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54849 req_id = c524d748-fc09-482f-bb84-246c387ca28a response_code = 200 uri = /vpc-routes
20662024-11-21T19:37:47.770ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
20672024-11-21T19:37:47.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54849 req_id = f22517b5-7c26-425c-abdd-4d47e36723c7 response_code = 204 uri = /eip-gateways
20682024-11-21T19:37:47.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54849 req_id = 32f93114-7631-4603-9bc7-7ab88d9e1de7 response_code = 204 uri = /vpc-routes
20692024-11-21T19:37:47.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56189
20702024-11-21T19:37:47.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56189 req_id = 4f37e182-13a7-46d8-ad64-08a52ffa437a response_code = 200 uri = /vpc-routes
20712024-11-21T19:37:47.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51347
20722024-11-21T19:37:47.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51347 req_id = e1fadb27-d3c2-4779-b12d-37a2506347d1 response_code = 200 uri = /v2p
20732024-11-21T19:37:47.904ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
20742024-11-21T19:37:47.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56189 req_id = 1958b24c-b02a-42ba-90b3-f4f37654c8c6 response_code = 204 uri = /eip-gateways
20752024-11-21T19:37:47.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56189 req_id = 90f1e3f4-df1f-4adb-a4d1-c1f85a266866 response_code = 204 uri = /vpc-routes
20762024-11-21T19:37:47.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62585
20772024-11-21T19:37:47.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20782024-11-21T19:37:48.001ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20792024-11-21T19:37:48.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97760 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62585 req_id = 26649b95-5ffe-48c2-8b79-8b8d7465c448 response_code = 204 uri = /switch-ports
20802024-11-21T19:37:48.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36146
20812024-11-21T19:37:48.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55965
20822024-11-21T19:37:48.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55965 req_id = 121969bb-9295-45ed-9d1f-b694c2b6b39d response_code = 200 uri = /v2p
20832024-11-21T19:37:48.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36146 req_id = f769ce65-eaca-41a2-9d05-3ccf79823d59 response_code = 200 uri = /vpc-routes
20842024-11-21T19:37:48.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62585 req_id = 5b0b9bcb-8c77-4045-806e-39cab13e20fa response_code = 200 uri = /network-bootstore-config
20852024-11-21T19:37:48.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59188
20862024-11-21T19:37:48.064ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20872024-11-21T19:37:48.102ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20882024-11-21T19:37:48.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102306 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59188 req_id = 5f90b3f1-2284-446c-8a2b-2925cfe96670 response_code = 204 uri = /switch-ports
20892024-11-21T19:37:48.167ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
20902024-11-21T19:37:48.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36146 req_id = 4c938dca-603f-43f8-b8be-90b5c7b71118 response_code = 204 uri = /eip-gateways
20912024-11-21T19:37:48.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33727
20922024-11-21T19:37:48.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20932024-11-21T19:37:48.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59188 req_id = fe95bfad-4fd4-4912-9f9f-d10cfdf1a1a8 response_code = 200 uri = /network-bootstore-config
20942024-11-21T19:37:48.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36146 req_id = 5626e2bd-7d00-43c6-a0b2-48bf9ae50c16 response_code = 204 uri = /vpc-routes
20952024-11-21T19:37:48.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49883
20962024-11-21T19:37:48.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49883 req_id = 8056d10d-dac2-47f4-bec1-ebf46d5fae48 response_code = 200 uri = /v2p
20972024-11-21T19:37:48.205ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20982024-11-21T19:37:48.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33727 req_id = 9372dd03-bf3a-408c-a371-732ab4d80f65 response_code = 204 uri = /switch-ports
20992024-11-21T19:37:48.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33727 req_id = 02d16502-81f3-478d-87ca-6ce900060582 response_code = 200 uri = /network-bootstore-config
21002024-11-21T19:38:06.914ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54027
21012024-11-21T19:38:06.914ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54027 req_id = 2348ceee-ab86-4b61-af19-4c3508924f3f response_code = 200 uri = /baseboard
21022024-11-21T19:38:17.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53204
21032024-11-21T19:38:17.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53204 req_id = f943f6ef-d5f1-4185-b6d3-acd1e93a4317 response_code = 200 uri = /vpc-routes
21042024-11-21T19:38:17.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
21052024-11-21T19:38:17.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53204 req_id = e5d390c1-7ef0-4048-a97c-5b02840152ec response_code = 204 uri = /eip-gateways
21062024-11-21T19:38:17.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53204 req_id = e4849b01-17cf-4cf7-ad2a-aa9cd6458028 response_code = 204 uri = /vpc-routes
21072024-11-21T19:38:17.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36620
21082024-11-21T19:38:17.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36620 req_id = 93021fb5-ac8a-448c-b535-6a8633638acd response_code = 200 uri = /vpc-routes
21092024-11-21T19:38:18.060ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
21102024-11-21T19:38:18.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36620 req_id = 43279d0a-d765-4cd9-8c72-db6bcb2c2239 response_code = 204 uri = /eip-gateways
21112024-11-21T19:38:18.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36620 req_id = c82c3d38-a2a2-4855-9a72-74b909089334 response_code = 204 uri = /vpc-routes
21122024-11-21T19:38:18.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37903
21132024-11-21T19:38:18.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37903 req_id = b22cb1e6-cd4e-4a04-8f8f-535902b27379 response_code = 200 uri = /v2p
21142024-11-21T19:38:18.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62844
21152024-11-21T19:38:18.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62844 req_id = 92741ae8-7cfe-4186-a894-bfcc5680788b response_code = 200 uri = /vpc-routes
21162024-11-21T19:38:18.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64536
21172024-11-21T19:38:18.177ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21182024-11-21T19:38:18.226ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21192024-11-21T19:38:18.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64536 req_id = 88e2c4fc-4c18-4ab8-83fa-b13131714d34 response_code = 204 uri = /switch-ports
21202024-11-21T19:38:18.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49274
21212024-11-21T19:38:18.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33739
21222024-11-21T19:38:18.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41182
21232024-11-21T19:38:18.296ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
21242024-11-21T19:38:18.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62844 req_id = e5b7ec28-db87-481b-a22f-f4c85052192c response_code = 204 uri = /eip-gateways
21252024-11-21T19:38:18.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64536 req_id = a4136cf6-b9d8-4862-9775-b52ce7e7b6e4 response_code = 200 uri = /network-bootstore-config
21262024-11-21T19:38:18.296ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21272024-11-21T19:38:18.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41182 req_id = b28ffd8d-d56f-4f66-8776-7418b8cc954b response_code = 200 uri = /v2p
21282024-11-21T19:38:18.302ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21292024-11-21T19:38:18.302ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21302024-11-21T19:38:18.302ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21312024-11-21T19:38:18.302ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21322024-11-21T19:38:18.302ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21332024-11-21T19:38:18.303ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
21342024-11-21T19:38:18.303ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21352024-11-21T19:38:18.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6860 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33739 req_id = 9bade654-f4c7-4b1c-a955-959a2d2b6a63 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21362024-11-21T19:38:18.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62844 req_id = 660948fe-f1d4-4f47-aaf8-cbe31eb81726 response_code = 204 uri = /vpc-routes
21372024-11-21T19:38:18.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34309
21382024-11-21T19:38:18.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21392024-11-21T19:38:18.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49551
21402024-11-21T19:38:18.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49551 req_id = 8b32aaa0-da09-43ac-8483-e44150ef6082 response_code = 200 uri = /v2p
21412024-11-21T19:38:18.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57454
21422024-11-21T19:38:18.385ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21432024-11-21T19:38:18.385ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21442024-11-21T19:38:18.385ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21452024-11-21T19:38:18.385ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21462024-11-21T19:38:18.385ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21472024-11-21T19:38:18.385ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
21482024-11-21T19:38:18.385ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21492024-11-21T19:38:18.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57454 req_id = 10a69a14-2df9-4e62-a61d-e48b7b0b8f9f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21502024-11-21T19:38:18.408ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21512024-11-21T19:38:18.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111984 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49274 req_id = 80f853d7-281e-4b99-8f01-443a4ffed72d response_code = 204 uri = /switch-ports
21522024-11-21T19:38:18.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 691 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49274 req_id = ab2957e3-7869-4a77-9664-1ee6cc7a15b3 response_code = 200 uri = /network-bootstore-config
21532024-11-21T19:38:18.448ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21542024-11-21T19:38:18.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55270
21552024-11-21T19:38:18.474ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21562024-11-21T19:38:18.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21572024-11-21T19:38:18.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21582024-11-21T19:38:18.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21592024-11-21T19:38:18.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21602024-11-21T19:38:18.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
21612024-11-21T19:38:18.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21622024-11-21T19:38:18.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 489 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55270 req_id = 6be5bbbe-9496-4261-a5f8-e0ef77fe168f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21632024-11-21T19:38:18.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34309 req_id = 928d5c9e-30bd-4fe7-8a1f-67b1405de9f2 response_code = 204 uri = /switch-ports
21642024-11-21T19:38:18.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34309 req_id = f40791ce-afe3-4063-8e18-1d19e82069be response_code = 200 uri = /network-bootstore-config
21652024-11-21T19:38:36.947ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43051
21662024-11-21T19:38:36.948ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43051 req_id = 4fd01336-1223-46a2-9e87-3725d3eecb5a response_code = 200 uri = /baseboard
21672024-11-21T19:38:47.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35634
21682024-11-21T19:38:47.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35634 req_id = cf3f6524-aead-4843-858c-a495a10286d4 response_code = 200 uri = /vpc-routes
21692024-11-21T19:38:47.769ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
21702024-11-21T19:38:47.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35634 req_id = 3ad0b021-9f42-4e10-9923-b3709e16a4b4 response_code = 204 uri = /eip-gateways
21712024-11-21T19:38:47.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35634 req_id = 7fbc9ed2-7057-48a5-b455-7d5901afecb3 response_code = 204 uri = /vpc-routes
21722024-11-21T19:38:47.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50421
21732024-11-21T19:38:47.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50421 req_id = 60bf37fe-3bd7-49b5-98eb-eec3e2099c2c response_code = 200 uri = /vpc-routes
21742024-11-21T19:38:47.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50966
21752024-11-21T19:38:47.858ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21762024-11-21T19:38:47.919ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21772024-11-21T19:38:47.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131230 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50966 req_id = d22fc258-b23c-4433-973c-87f59154a4b7 response_code = 204 uri = /switch-ports
21782024-11-21T19:38:47.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41854
21792024-11-21T19:38:47.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50140
21802024-11-21T19:38:47.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38047
21812024-11-21T19:38:47.989ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
21822024-11-21T19:38:47.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50421 req_id = d47b4d4d-a28c-4216-ad31-7754cc80503c response_code = 204 uri = /eip-gateways
21832024-11-21T19:38:47.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50966 req_id = 2362d908-6e87-4c38-813d-e29e957a57c5 response_code = 200 uri = /network-bootstore-config
21842024-11-21T19:38:47.990ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21852024-11-21T19:38:47.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50140 req_id = d8e238f7-e094-467d-be1b-c1b7d2f5363a response_code = 200 uri = /v2p
21862024-11-21T19:38:47.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 412 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41854 req_id = 649e6a0f-68fc-4931-bc86-850e37bf066a response_code = 200 uri = /v2p
21872024-11-21T19:38:48.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52312
21882024-11-21T19:38:48.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1058 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50421 req_id = aeb78592-8af2-469d-9439-6cb114194c4d response_code = 204 uri = /vpc-routes
21892024-11-21T19:38:48.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52312 req_id = 4419e36b-a9b3-49a6-8fc3-b63d0733c26a response_code = 200 uri = /vpc-routes
21902024-11-21T19:38:48.031ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21912024-11-21T19:38:48.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35892
21922024-11-21T19:38:48.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35892 req_id = 2102f6c2-066a-469c-b53b-9d646e2220d5 response_code = 200 uri = /v2p
21932024-11-21T19:38:48.058ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
21942024-11-21T19:38:48.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 522 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52312 req_id = d0f049fe-b150-43ae-b945-3a1b8099c48d response_code = 204 uri = /eip-gateways
21952024-11-21T19:38:48.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52312 req_id = 17737a7f-9e34-40d2-bd65-6003cb458f43 response_code = 204 uri = /vpc-routes
21962024-11-21T19:38:48.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38047 req_id = 500cc2ff-f9b5-40d3-80df-02624a560c50 response_code = 204 uri = /switch-ports
21972024-11-21T19:38:48.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38047 req_id = c43357f1-c709-490b-bb9d-865236f0b14d response_code = 200 uri = /network-bootstore-config
21982024-11-21T19:38:48.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61844
21992024-11-21T19:38:48.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22002024-11-21T19:38:48.159ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22012024-11-21T19:38:48.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93287 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61844 req_id = 8e72efc4-93be-4732-9406-845c03949a9e response_code = 204 uri = /switch-ports
22022024-11-21T19:38:48.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61844 req_id = 7e6bd75f-6194-441d-bbe2-4988b59869e0 response_code = 200 uri = /network-bootstore-config
22032024-11-21T19:39:06.982ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50979
22042024-11-21T19:39:06.982ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50979 req_id = 22794df4-831c-4508-8cc1-64de78540343 response_code = 200 uri = /baseboard
22052024-11-21T19:39:17.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60125
22062024-11-21T19:39:17.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60125 req_id = ba784685-66f2-47f3-b24a-7e477fa180a8 response_code = 200 uri = /vpc-routes
22072024-11-21T19:39:17.916ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
22082024-11-21T19:39:17.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60125 req_id = 708fd703-c0ec-4df1-8772-eebae4dd5b64 response_code = 204 uri = /eip-gateways
22092024-11-21T19:39:17.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44771
22102024-11-21T19:39:17.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44771 req_id = ca61c88e-a04f-4f33-bf49-cb0cd321f93d response_code = 200 uri = /vpc-routes
22112024-11-21T19:39:18.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37034
22122024-11-21T19:39:18.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37034 req_id = 5a0282ba-75aa-40c6-a3c3-c9989afc3b3b response_code = 200 uri = /v2p
22132024-11-21T19:39:18.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60125 req_id = d0ce2ef3-68e1-4ce1-ad48-2aae132da0a5 response_code = 204 uri = /vpc-routes
22142024-11-21T19:39:18.069ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
22152024-11-21T19:39:18.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44771 req_id = 6de05d96-b0ee-4a4e-a315-c177dbc028c4 response_code = 204 uri = /eip-gateways
22162024-11-21T19:39:18.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44771 req_id = 5b76d60a-818b-415b-87a0-9a274cde3163 response_code = 204 uri = /vpc-routes
22172024-11-21T19:39:18.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42373
22182024-11-21T19:39:18.114ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22192024-11-21T19:39:18.166ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22202024-11-21T19:39:18.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42373 req_id = cb5a26ce-9c75-4c92-ae3a-ff5ad1932689 response_code = 204 uri = /switch-ports
22212024-11-21T19:39:18.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63499
22222024-11-21T19:39:18.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46366
22232024-11-21T19:39:18.234ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22242024-11-21T19:39:18.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42373 req_id = 05a3a339-cc37-4f07-8021-ff230b35f252 response_code = 200 uri = /network-bootstore-config
22252024-11-21T19:39:18.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63499 req_id = 8dfc1f3d-64a5-4191-a069-9c26bcc4b15d response_code = 200 uri = /v2p
22262024-11-21T19:39:18.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37721
22272024-11-21T19:39:18.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37721 req_id = 77d32788-7ecd-47f6-a69e-0994fd36b89f response_code = 200 uri = /vpc-routes
22282024-11-21T19:39:18.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
22292024-11-21T19:39:18.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37721 req_id = 75e3a68e-3411-43c2-8d45-6414ddd0da81 response_code = 204 uri = /eip-gateways
22302024-11-21T19:39:18.265ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22312024-11-21T19:39:18.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62680
22322024-11-21T19:39:18.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62680 req_id = 1d3a6082-3ae1-41f3-9b90-cd64cd35cb14 response_code = 200 uri = /v2p
22332024-11-21T19:39:18.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37721 req_id = 8c545a6c-f4fd-4319-b21b-3e70176de975 response_code = 204 uri = /vpc-routes
22342024-11-21T19:39:18.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83130 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46366 req_id = 019af5f0-acac-4bca-af9e-2ce65040238a response_code = 204 uri = /switch-ports
22352024-11-21T19:39:18.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46366 req_id = 3cdaed39-483a-440f-9e11-c09a229820a4 response_code = 200 uri = /network-bootstore-config
22362024-11-21T19:39:18.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38185
22372024-11-21T19:39:18.384ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22382024-11-21T19:39:18.422ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22392024-11-21T19:39:18.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91380 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38185 req_id = 2fb87d6a-7697-4761-ab9a-c19f29ac0d0e response_code = 204 uri = /switch-ports
22402024-11-21T19:39:18.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38185 req_id = 9f1a1dec-d8af-48e1-aa51-b919c6fc5f2c response_code = 200 uri = /network-bootstore-config
22412024-11-21T19:39:37.014ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49174
22422024-11-21T19:39:37.014ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49174 req_id = 4e325ec9-ebe5-42b0-8899-001f93b7c774 response_code = 200 uri = /baseboard
22432024-11-21T19:39:42.610ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22442024-11-21T19:39:42.611ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22452024-11-21T19:39:42.645ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1725, tv_nsec: 520668525 } time_to_next_cleanup = 599.99999677s
22462024-11-21T19:39:47.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52796
22472024-11-21T19:39:47.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52796 req_id = 38bfca96-68c4-4603-8220-8d4019c5f847 response_code = 200 uri = /vpc-routes
22482024-11-21T19:39:47.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60482
22492024-11-21T19:39:47.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60482 req_id = b719ee33-4af9-4e8e-be93-1eadcac3bcbd response_code = 200 uri = /vpc-routes
22502024-11-21T19:39:47.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
22512024-11-21T19:39:47.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60482 req_id = f159bb1a-a294-474e-b39c-ecec517e38d1 response_code = 204 uri = /eip-gateways
22522024-11-21T19:39:47.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60482 req_id = c578a603-236e-4eaf-ba83-f244f7021529 response_code = 204 uri = /vpc-routes
22532024-11-21T19:39:47.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
22542024-11-21T19:39:47.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52796 req_id = 82b93366-02ed-4741-9651-99d1ac3856cc response_code = 204 uri = /eip-gateways
22552024-11-21T19:39:47.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52796 req_id = 87e60531-caef-4bd1-a1c5-e99665bc51b4 response_code = 204 uri = /vpc-routes
22562024-11-21T19:39:47.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59980
22572024-11-21T19:39:47.879ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22582024-11-21T19:39:47.930ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22592024-11-21T19:39:47.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119442 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59980 req_id = 238774bd-0baf-4556-97cb-8e27392f3b69 response_code = 204 uri = /switch-ports
22602024-11-21T19:39:47.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46897
22612024-11-21T19:39:47.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58973
22622024-11-21T19:39:47.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36692
22632024-11-21T19:39:47.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39460
22642024-11-21T19:39:47.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59980 req_id = 1832aeff-db73-44bd-9b3b-1778a91f1632 response_code = 200 uri = /network-bootstore-config
22652024-11-21T19:39:47.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46897 req_id = ef499906-cecc-44d4-a3da-93c4e71384cc response_code = 200 uri = /v2p
22662024-11-21T19:39:47.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39460 req_id = bf30f967-8110-4f4a-ae72-f187800dd1ed response_code = 200 uri = /vpc-routes
22672024-11-21T19:39:47.999ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22682024-11-21T19:39:47.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58973 req_id = 4c9a8a5c-cde0-4ef7-b616-1f6726449db7 response_code = 200 uri = /v2p
22692024-11-21T19:39:48.042ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22702024-11-21T19:39:48.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107741 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36692 req_id = db0206aa-d694-4d78-92b5-d5c04294c543 response_code = 204 uri = /switch-ports
22712024-11-21T19:39:48.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36692 req_id = a2eaff7e-4b1b-4ade-a3bb-06287df7127a response_code = 200 uri = /network-bootstore-config
22722024-11-21T19:39:48.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51417
22732024-11-21T19:39:48.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51417 req_id = 387db6cf-df41-43e0-91f3-59cf6d554193 response_code = 200 uri = /v2p
22742024-11-21T19:39:48.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
22752024-11-21T19:39:48.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39460 req_id = d1326a7e-730d-4ff1-a865-1a05ab706dd3 response_code = 204 uri = /eip-gateways
22762024-11-21T19:39:48.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39460 req_id = addade80-8c6b-4eb1-b81e-284467ec608c response_code = 204 uri = /vpc-routes
22772024-11-21T19:39:48.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53581
22782024-11-21T19:39:48.226ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22792024-11-21T19:39:48.266ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22802024-11-21T19:39:48.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101044 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53581 req_id = f64f3072-c6a0-4670-a567-318702edba16 response_code = 204 uri = /switch-ports
22812024-11-21T19:39:48.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53581 req_id = 211ab2d4-be28-4054-990e-15a86e338595 response_code = 200 uri = /network-bootstore-config
22822024-11-21T19:39:57.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22832024-11-21T19:40:07.052ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45895
22842024-11-21T19:40:07.052ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45895 req_id = 95760295-131b-40e2-9957-392ce3cfbdab response_code = 200 uri = /baseboard
22852024-11-21T19:40:17.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56537
22862024-11-21T19:40:17.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56537 req_id = 5cf8801d-2e99-45e0-a98b-5af64ca684f0 response_code = 200 uri = /vpc-routes
22872024-11-21T19:40:17.874ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
22882024-11-21T19:40:17.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56537 req_id = 22532df1-2068-4a16-bc94-3946f53eaa1c response_code = 204 uri = /eip-gateways
22892024-11-21T19:40:17.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56537 req_id = 344d82dc-9823-48d4-aa3d-d4767f5a290e response_code = 204 uri = /vpc-routes
22902024-11-21T19:40:17.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54422
22912024-11-21T19:40:17.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54422 req_id = 608eaac2-c22d-4341-84f5-fac63e58f0c4 response_code = 200 uri = /vpc-routes
22922024-11-21T19:40:17.990ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
22932024-11-21T19:40:17.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54422 req_id = f788281f-3faf-409b-9859-27d4b5e8344e response_code = 204 uri = /eip-gateways
22942024-11-21T19:40:18.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50882
22952024-11-21T19:40:18.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50882 req_id = 05408cbc-e8eb-4094-862a-154008f4a650 response_code = 200 uri = /v2p
22962024-11-21T19:40:18.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38348
22972024-11-21T19:40:18.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38348 req_id = 3cb8887f-a053-41b8-ab72-e63df965a593 response_code = 200 uri = /v2p
22982024-11-21T19:40:18.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54422 req_id = 1af28dac-a02f-4c32-aebe-04066bf65090 response_code = 204 uri = /vpc-routes
22992024-11-21T19:40:18.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46465
23002024-11-21T19:40:18.082ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23012024-11-21T19:40:18.127ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23022024-11-21T19:40:18.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106743 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46465 req_id = 8c599275-9a64-4736-83df-b941c89fd93c response_code = 204 uri = /switch-ports
23032024-11-21T19:40:18.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61328
23042024-11-21T19:40:18.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23052024-11-21T19:40:18.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4031 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46465 req_id = 59aa8a97-1fa8-41bf-b722-ec6ee90d2a3a response_code = 200 uri = /network-bootstore-config
23062024-11-21T19:40:18.224ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23072024-11-21T19:40:18.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91139 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61328 req_id = cf190823-676b-4246-9e8c-f1009848aa08 response_code = 204 uri = /switch-ports
23082024-11-21T19:40:18.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61328 req_id = 3fed7bac-d805-4a30-91d2-c46f8e25b475 response_code = 200 uri = /network-bootstore-config
23092024-11-21T19:40:18.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59054
23102024-11-21T19:40:18.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59054 req_id = 716fe2cf-e497-4792-8552-7988a4a24b59 response_code = 200 uri = /vpc-routes
23112024-11-21T19:40:18.318ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
23122024-11-21T19:40:18.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59054 req_id = 99795556-8170-461e-8ad9-e09de51799b4 response_code = 204 uri = /eip-gateways
23132024-11-21T19:40:18.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37423
23142024-11-21T19:40:18.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37423 req_id = 316ab66d-3a9f-4ceb-bf19-ce17fe9b9cef response_code = 200 uri = /v2p
23152024-11-21T19:40:18.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59054 req_id = d8bcd7e5-a1c4-49d1-8cb4-c7d2e1b820f8 response_code = 204 uri = /vpc-routes
23162024-11-21T19:40:18.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40234
23172024-11-21T19:40:18.380ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23182024-11-21T19:40:18.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23192024-11-21T19:40:18.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94512 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40234 req_id = b6bb022f-5446-4b1e-b9c1-1fd64b7438e1 response_code = 204 uri = /switch-ports
23202024-11-21T19:40:18.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40234 req_id = e33664e6-6e41-4b2b-800c-9381ac5256dd response_code = 200 uri = /network-bootstore-config
23212024-11-21T19:40:37.085ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49181
23222024-11-21T19:40:37.085ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49181 req_id = 188c6067-b9f8-4122-891c-efe76bbbbc5a response_code = 200 uri = /baseboard
23232024-11-21T19:40:47.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54583
23242024-11-21T19:40:47.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54583 req_id = ccb8c05b-913b-4073-a357-835f2c722f09 response_code = 200 uri = /vpc-routes
23252024-11-21T19:40:47.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
23262024-11-21T19:40:47.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54583 req_id = 871416b4-2ec1-4501-acae-068e28f3823b response_code = 204 uri = /eip-gateways
23272024-11-21T19:40:47.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54583 req_id = c9188310-881a-4451-9c42-4d7ecd16de80 response_code = 204 uri = /vpc-routes
23282024-11-21T19:40:47.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50604
23292024-11-21T19:40:47.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50604 req_id = 4dd6d3a5-9347-4e7f-9eab-7f6ac58b5427 response_code = 200 uri = /vpc-routes
23302024-11-21T19:40:47.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41396
23312024-11-21T19:40:47.997ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23322024-11-21T19:40:48.044ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23332024-11-21T19:40:48.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41396 req_id = ceb8e4ff-d7b5-4efa-b056-be034ce68a56 response_code = 204 uri = /switch-ports
23342024-11-21T19:40:48.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39760
23352024-11-21T19:40:48.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42389
23362024-11-21T19:40:48.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
23372024-11-21T19:40:48.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50604 req_id = 776edff8-6a68-4df1-bf6f-bab289d74d5f response_code = 204 uri = /eip-gateways
23382024-11-21T19:40:48.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41396 req_id = 8c640f97-08f7-42aa-8dfa-b97684ea3465 response_code = 200 uri = /network-bootstore-config
23392024-11-21T19:40:48.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23402024-11-21T19:40:48.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3886 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42389 req_id = 8975bc55-1d8d-41f2-800a-64b402f63e4d response_code = 200 uri = /v2p
23412024-11-21T19:40:48.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48283
23422024-11-21T19:40:48.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48283 req_id = ee1da398-3295-4b2b-b591-26cf695e1aa8 response_code = 200 uri = /vpc-routes
23432024-11-21T19:40:48.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50604 req_id = 3131b5cd-715e-4936-a005-72dea6a55454 response_code = 204 uri = /vpc-routes
23442024-11-21T19:40:48.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47742
23452024-11-21T19:40:48.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47742 req_id = c2d5b6fc-bdf5-405d-8055-c7cbee063248 response_code = 200 uri = /v2p
23462024-11-21T19:40:48.164ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23472024-11-21T19:40:48.181ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
23482024-11-21T19:40:48.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3979 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48283 req_id = d24d4841-ea01-486c-8210-b08fa78fd07f response_code = 204 uri = /eip-gateways
23492024-11-21T19:40:48.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 754 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48283 req_id = 2783746c-2200-4d9d-a680-a1f1511d0c83 response_code = 204 uri = /vpc-routes
23502024-11-21T19:40:48.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42911
23512024-11-21T19:40:48.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108235 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39760 req_id = 9de3e0b3-a71f-42f6-b092-4101161e0f4d response_code = 204 uri = /switch-ports
23522024-11-21T19:40:48.224ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23532024-11-21T19:40:48.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 731 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39760 req_id = 536b82ac-e282-4cee-b2aa-d86a307d51f3 response_code = 200 uri = /network-bootstore-config
23542024-11-21T19:40:48.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48836
23552024-11-21T19:40:48.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48836 req_id = 93a807df-d27e-464c-af60-4414522c0765 response_code = 200 uri = /v2p
23562024-11-21T19:40:48.259ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23572024-11-21T19:40:48.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89097 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42911 req_id = a9c72e34-37ec-4543-9616-bbb74d02b6e5 response_code = 204 uri = /switch-ports
23582024-11-21T19:40:48.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42911 req_id = 54b73caf-fe46-479f-a27b-7cd824e22438 response_code = 200 uri = /network-bootstore-config
23592024-11-21T19:40:56.762ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
23602024-11-21T19:40:56.895ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
23612024-11-21T19:41:06.691ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
23622024-11-21T19:41:06.760ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
23632024-11-21T19:41:06.765ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
23642024-11-21T19:41:06.897ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
23652024-11-21T19:41:07.121ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35257
23662024-11-21T19:41:07.121ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35257 req_id = dbcafa61-0764-4311-a649-1b1afee6b767 response_code = 200 uri = /baseboard
23672024-11-21T19:41:16.696ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
23682024-11-21T19:41:16.762ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
23692024-11-21T19:41:16.767ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
23702024-11-21T19:41:16.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
23712024-11-21T19:41:17.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63079
23722024-11-21T19:41:17.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63079 req_id = f1c28a2c-ba05-4fda-888e-1888b4e9b4b9 response_code = 200 uri = /vpc-routes
23732024-11-21T19:41:17.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34271
23742024-11-21T19:41:17.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34271 req_id = 5fe5a23b-6774-4b7f-88c7-abaf582b52db response_code = 200 uri = /vpc-routes
23752024-11-21T19:41:18.012ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
23762024-11-21T19:41:18.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63079 req_id = ac24cb2b-36d7-4831-b8e3-89a2169c92ed response_code = 204 uri = /eip-gateways
23772024-11-21T19:41:18.030ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
23782024-11-21T19:41:18.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34271 req_id = a9811b4d-5336-4627-8964-719f0b58cc29 response_code = 204 uri = /eip-gateways
23792024-11-21T19:41:18.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34271 req_id = eec8860c-9cab-4771-9b62-56b534c60367 response_code = 204 uri = /vpc-routes
23802024-11-21T19:41:18.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37855
23812024-11-21T19:41:18.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37855 req_id = 449a0ba3-5281-4164-b56a-4c1150cde42e response_code = 200 uri = /v2p
23822024-11-21T19:41:18.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63079 req_id = 46e94d18-df6c-4158-a357-4706df93a90d response_code = 204 uri = /vpc-routes
23832024-11-21T19:41:18.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43516
23842024-11-21T19:41:18.131ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23852024-11-21T19:41:18.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23862024-11-21T19:41:18.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58582
23872024-11-21T19:41:18.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58582 req_id = d8446249-5cff-4ada-89bd-a4b598c85b1c response_code = 200 uri = /v2p
23882024-11-21T19:41:18.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40433
23892024-11-21T19:41:18.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103578 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43516 req_id = 39fb61b8-8b92-4f64-af85-81bf0da94fba response_code = 204 uri = /switch-ports
23902024-11-21T19:41:18.235ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23912024-11-21T19:41:18.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 816 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43516 req_id = 7781e60f-d056-40a3-b566-5d9ec205b963 response_code = 200 uri = /network-bootstore-config
23922024-11-21T19:41:18.276ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23932024-11-21T19:41:18.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43824
23942024-11-21T19:41:18.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43824 req_id = f810ae69-e2d9-405b-b4d9-656a39e03e99 response_code = 200 uri = /v2p
23952024-11-21T19:41:18.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50503
23962024-11-21T19:41:18.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50503 req_id = 28426252-144c-49bf-a7fd-2199533b8600 response_code = 200 uri = /vpc-routes
23972024-11-21T19:41:18.333ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
23982024-11-21T19:41:18.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50503 req_id = 6b0c9147-18d8-4cbd-8603-b9bc7ec2af2c response_code = 204 uri = /eip-gateways
23992024-11-21T19:41:18.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132942 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40433 req_id = b8a66eaf-f2e2-4481-bb0e-f3c1f1db3593 response_code = 204 uri = /switch-ports
24002024-11-21T19:41:18.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40433 req_id = f8b2ce72-9c61-40b8-bb2f-0d3e238fccc7 response_code = 200 uri = /network-bootstore-config
24012024-11-21T19:41:18.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50503 req_id = 3d816078-c375-4ea7-9f10-04773f3bf75b response_code = 204 uri = /vpc-routes
24022024-11-21T19:41:18.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60718
24032024-11-21T19:41:18.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24042024-11-21T19:41:18.432ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24052024-11-21T19:41:18.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93261 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60718 req_id = 7ecf7ba2-cc72-44d5-bb00-604172cd2a3e response_code = 204 uri = /switch-ports
24062024-11-21T19:41:18.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60718 req_id = 2f726b27-d3c9-4101-96e0-468aae7d7596 response_code = 200 uri = /network-bootstore-config
24072024-11-21T19:41:26.701ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24082024-11-21T19:41:26.764ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24092024-11-21T19:41:26.770ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24102024-11-21T19:41:26.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24112024-11-21T19:41:36.706ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24122024-11-21T19:41:36.766ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24132024-11-21T19:41:36.773ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24142024-11-21T19:41:36.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24152024-11-21T19:41:37.154ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36963
24162024-11-21T19:41:37.154ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36963 req_id = ae9ae2b6-b6be-4c36-896e-6b41ebe6fa2f response_code = 200 uri = /baseboard
24172024-11-21T19:41:46.711ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24182024-11-21T19:41:46.768ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24192024-11-21T19:41:46.774ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24202024-11-21T19:41:46.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24212024-11-21T19:41:47.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55936
24222024-11-21T19:41:47.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55936 req_id = 19f272c5-5f37-4e13-bc44-5b48cd20c4df response_code = 200 uri = /vpc-routes
24232024-11-21T19:41:47.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47830
24242024-11-21T19:41:47.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47830 req_id = 077d288f-3e73-4ffb-864f-dcde88a60731 response_code = 200 uri = /vpc-routes
24252024-11-21T19:41:47.840ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
24262024-11-21T19:41:47.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55936 req_id = 24597aea-a221-46ce-92d8-1fdc3b7d1860 response_code = 204 uri = /eip-gateways
24272024-11-21T19:41:47.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37610
24282024-11-21T19:41:47.850ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24292024-11-21T19:41:47.909ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24302024-11-21T19:41:47.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137165 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37610 req_id = 52b623c4-2ee1-4d95-89c1-33e2c093238b response_code = 204 uri = /switch-ports
24312024-11-21T19:41:47.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51824
24322024-11-21T19:41:47.988ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
24332024-11-21T19:41:47.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47830 req_id = 55e7b380-bcea-4cce-b46f-900df5bdabb0 response_code = 204 uri = /eip-gateways
24342024-11-21T19:41:47.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36152
24352024-11-21T19:41:47.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37610 req_id = 200d49e7-6175-4147-b7fc-99c0a40d910d response_code = 200 uri = /network-bootstore-config
24362024-11-21T19:41:47.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 494 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55936 req_id = ea171fe3-9fdf-454f-8c8f-64d302323527 response_code = 204 uri = /vpc-routes
24372024-11-21T19:41:47.988ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24382024-11-21T19:41:47.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11039 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36152 req_id = c023fbda-4f35-44f5-bda4-fee8f5936e9d response_code = 200 uri = /v2p
24392024-11-21T19:41:47.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39584
24402024-11-21T19:41:48.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39584 req_id = 77737a20-65d8-48c8-85be-568665622545 response_code = 200 uri = /v2p
24412024-11-21T19:41:48.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 578 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47830 req_id = a7cdeb2f-7ce0-4186-855f-06b66be6a5a9 response_code = 204 uri = /vpc-routes
24422024-11-21T19:41:48.033ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24432024-11-21T19:41:48.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56021
24442024-11-21T19:41:48.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56021 req_id = 3c7a0edf-9227-489a-9773-9e971d99af52 response_code = 200 uri = /vpc-routes
24452024-11-21T19:41:48.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
24462024-11-21T19:41:48.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56021 req_id = a42a2c42-0213-4476-bd3a-90548f50dc38 response_code = 204 uri = /eip-gateways
24472024-11-21T19:41:48.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1000 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56021 req_id = 52471154-ca24-4122-a65d-f1542c5101e0 response_code = 204 uri = /vpc-routes
24482024-11-21T19:41:48.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110212 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51824 req_id = 4c22b181-1b06-4e67-8369-00b64862b841 response_code = 204 uri = /switch-ports
24492024-11-21T19:41:48.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51824 req_id = 150c3e32-1b16-4082-9e6c-2e5fcadd2e93 response_code = 200 uri = /network-bootstore-config
24502024-11-21T19:41:48.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38407
24512024-11-21T19:41:48.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38407 req_id = 93877451-ffaf-47f1-af82-e34ab1603d9f response_code = 200 uri = /v2p
24522024-11-21T19:41:48.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36893
24532024-11-21T19:41:48.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24542024-11-21T19:41:48.194ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24552024-11-21T19:41:48.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36893 req_id = 7b9f3a7a-41ff-4371-bb47-11de767fc415 response_code = 204 uri = /switch-ports
24562024-11-21T19:41:48.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36893 req_id = 980ca5cf-7899-4673-9b7d-a61cc9a7792e response_code = 200 uri = /network-bootstore-config
24572024-11-21T19:41:56.716ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24582024-11-21T19:41:56.771ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24592024-11-21T19:41:56.777ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24602024-11-21T19:41:56.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24612024-11-21T19:42:06.721ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24622024-11-21T19:42:06.773ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24632024-11-21T19:42:06.778ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24642024-11-21T19:42:06.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24652024-11-21T19:42:07.188ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56308
24662024-11-21T19:42:07.188ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56308 req_id = 33678eda-5d89-4c8e-a221-0e2d54f76a94 response_code = 200 uri = /baseboard
24672024-11-21T19:42:16.725ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24682024-11-21T19:42:16.775ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24692024-11-21T19:42:16.781ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24702024-11-21T19:42:16.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
24712024-11-21T19:42:17.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44044
24722024-11-21T19:42:17.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44044 req_id = 415a42c2-70cb-4b62-a1cb-65724b821a17 response_code = 200 uri = /vpc-routes
24732024-11-21T19:42:18.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61019
24742024-11-21T19:42:18.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61019 req_id = 0995c399-71af-485c-a724-6bdbe1349212 response_code = 200 uri = /vpc-routes
24752024-11-21T19:42:18.034ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
24762024-11-21T19:42:18.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44044 req_id = 35a9ed6d-9e8f-4909-96dc-2a028292bdeb response_code = 204 uri = /eip-gateways
24772024-11-21T19:42:18.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44044 req_id = a1862a47-835c-4208-b034-1a070af3d9b7 response_code = 204 uri = /vpc-routes
24782024-11-21T19:42:18.074ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
24792024-11-21T19:42:18.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61019 req_id = f34d8769-65dd-4dc4-be95-d7ecddde0071 response_code = 204 uri = /eip-gateways
24802024-11-21T19:42:18.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49713
24812024-11-21T19:42:18.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49713 req_id = df767e52-d2eb-4dc1-ad9b-becede974ab1 response_code = 200 uri = /v2p
24822024-11-21T19:42:18.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61019 req_id = 8d4f5d26-0018-4145-89b7-ce363584e83f response_code = 204 uri = /vpc-routes
24832024-11-21T19:42:18.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61487
24842024-11-21T19:42:18.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24852024-11-21T19:42:18.236ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24862024-11-21T19:42:18.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113149 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61487 req_id = 13e030c3-f6ab-41e0-bf4e-f4403a579a7f response_code = 204 uri = /switch-ports
24872024-11-21T19:42:18.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46609
24882024-11-21T19:42:18.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46609 req_id = 3c427772-f60b-4087-b145-15ef07d5bd0e response_code = 200 uri = /v2p
24892024-11-21T19:42:18.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61487 req_id = 6c5b99fd-2767-48c6-9d43-0226cea2679b response_code = 200 uri = /network-bootstore-config
24902024-11-21T19:42:18.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60645
24912024-11-21T19:42:18.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60645 req_id = 51dd8574-88de-4e4c-9853-ad0c58be5f53 response_code = 200 uri = /vpc-routes
24922024-11-21T19:42:18.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55989
24932024-11-21T19:42:18.324ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24942024-11-21T19:42:18.364ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24952024-11-21T19:42:18.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101304 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55989 req_id = f1f41efa-5861-4de0-b7db-d879e769d3a1 response_code = 204 uri = /switch-ports
24962024-11-21T19:42:18.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42789
24972024-11-21T19:42:18.426ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
24982024-11-21T19:42:18.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60645 req_id = 75de3b66-0275-41b7-91cc-d26b118996e5 response_code = 204 uri = /eip-gateways
24992024-11-21T19:42:18.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55989 req_id = 5d176023-5044-4c82-b379-9eb7bc983a17 response_code = 200 uri = /network-bootstore-config
25002024-11-21T19:42:18.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42789 req_id = 8a508f01-795b-4c1d-86c8-5000e5498a2c response_code = 200 uri = /v2p
25012024-11-21T19:42:18.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60645 req_id = 71a3b7de-4705-4198-8446-bab91677f723 response_code = 204 uri = /vpc-routes
25022024-11-21T19:42:18.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48795
25032024-11-21T19:42:18.497ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25042024-11-21T19:42:18.538ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25052024-11-21T19:42:18.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98559 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48795 req_id = 43913cb6-fa3e-461a-aca0-2a4ce1f5c621 response_code = 204 uri = /switch-ports
25062024-11-21T19:42:18.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48795 req_id = 385eedaf-fb29-4d2b-b469-54df73436e95 response_code = 200 uri = /network-bootstore-config
25072024-11-21T19:42:26.729ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25082024-11-21T19:42:26.777ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25092024-11-21T19:42:26.783ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25102024-11-21T19:42:26.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25112024-11-21T19:42:36.734ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25122024-11-21T19:42:36.779ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25132024-11-21T19:42:36.784ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25142024-11-21T19:42:36.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25152024-11-21T19:42:37.224ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37240
25162024-11-21T19:42:37.224ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37240 req_id = 58a26386-e9bc-469f-a95e-c18afd24ea64 response_code = 200 uri = /baseboard
25172024-11-21T19:42:46.738ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25182024-11-21T19:42:46.780ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25192024-11-21T19:42:46.786ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25202024-11-21T19:42:46.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25212024-11-21T19:42:47.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55885
25222024-11-21T19:42:47.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55885 req_id = 92d28e82-f524-4f47-a830-2acb0c0ad33d response_code = 200 uri = /v2p
25232024-11-21T19:42:47.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45332
25242024-11-21T19:42:47.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45332 req_id = 381ded72-0f6f-43b2-935c-fd71f9e8c39d response_code = 200 uri = /vpc-routes
25252024-11-21T19:42:47.811ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
25262024-11-21T19:42:47.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45332 req_id = 2c1a5003-a0c0-4421-bbd3-089fda053a19 response_code = 204 uri = /eip-gateways
25272024-11-21T19:42:47.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45332 req_id = 27909392-193d-40f0-9299-f6299b58f9fe response_code = 204 uri = /vpc-routes
25282024-11-21T19:42:47.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58985
25292024-11-21T19:42:47.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58985 req_id = 3e622695-6aea-4617-ae74-9162bb8adfd4 response_code = 200 uri = /vpc-routes
25302024-11-21T19:42:47.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62746
25312024-11-21T19:42:47.899ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25322024-11-21T19:42:47.956ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25332024-11-21T19:42:48.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137916 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62746 req_id = 020579a5-4a5e-490a-9d62-fbe9a30ed927 response_code = 204 uri = /switch-ports
25342024-11-21T19:42:48.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56118
25352024-11-21T19:42:48.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52519
25362024-11-21T19:42:48.037ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
25372024-11-21T19:42:48.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58985 req_id = 4e4615f6-97a6-4043-8663-b3ab9711603d response_code = 204 uri = /eip-gateways
25382024-11-21T19:42:48.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62746 req_id = d5488554-2dde-489c-bb37-11353db2ee87 response_code = 200 uri = /network-bootstore-config
25392024-11-21T19:42:48.038ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25402024-11-21T19:42:48.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52519 req_id = 6c827b85-4c6d-4642-9834-9adad12d05b6 response_code = 200 uri = /v2p
25412024-11-21T19:42:48.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58985 req_id = 49af8787-239f-4ce5-9363-3dbbec6bfe70 response_code = 204 uri = /vpc-routes
25422024-11-21T19:42:48.081ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25432024-11-21T19:42:48.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34322
25442024-11-21T19:42:48.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34322 req_id = 01426a4f-131c-478f-a856-78b0f47cbff8 response_code = 200 uri = /vpc-routes
25452024-11-21T19:42:48.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56118 req_id = 4944d123-4968-4be3-a6b8-282bbfa3be51 response_code = 204 uri = /switch-ports
25462024-11-21T19:42:48.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56118 req_id = 1d715044-fad9-4b76-a67d-197dc24ce913 response_code = 200 uri = /network-bootstore-config
25472024-11-21T19:42:48.161ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
25482024-11-21T19:42:48.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34322 req_id = 9fa78371-4382-41fc-8c1c-202e7e3c7a47 response_code = 204 uri = /eip-gateways
25492024-11-21T19:42:48.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34322 req_id = 7749a250-a182-4311-891f-976a53ef1dd2 response_code = 204 uri = /vpc-routes
25502024-11-21T19:42:48.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60470
25512024-11-21T19:42:48.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60470 req_id = e239ed1a-b34d-4e8b-b158-14a58a19403c response_code = 200 uri = /v2p
25522024-11-21T19:42:48.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38048
25532024-11-21T19:42:48.231ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25542024-11-21T19:42:48.272ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25552024-11-21T19:42:48.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97098 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38048 req_id = 7cb21b26-bec5-4d16-a69e-5cb61f34400b response_code = 204 uri = /switch-ports
25562024-11-21T19:42:48.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38048 req_id = 0da11059-bcee-47df-a38b-1d4617ae6ab3 response_code = 200 uri = /network-bootstore-config
25572024-11-21T19:42:56.743ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25582024-11-21T19:42:56.783ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25592024-11-21T19:42:56.788ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25602024-11-21T19:42:56.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25612024-11-21T19:43:06.747ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25622024-11-21T19:43:06.785ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25632024-11-21T19:43:06.789ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25642024-11-21T19:43:06.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25652024-11-21T19:43:07.257ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33511
25662024-11-21T19:43:07.258ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33511 req_id = 63c9509f-f571-43e2-9e0a-f6d6e8632d15 response_code = 200 uri = /baseboard
25672024-11-21T19:43:16.752ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25682024-11-21T19:43:16.786ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25692024-11-21T19:43:16.791ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25702024-11-21T19:43:16.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
25712024-11-21T19:43:18.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34642
25722024-11-21T19:43:18.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34642 req_id = cd8996c5-48c8-4bf1-8978-827ccf44ed0f response_code = 200 uri = /vpc-routes
25732024-11-21T19:43:18.081ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
25742024-11-21T19:43:18.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34642 req_id = 758f419d-1f0c-4939-b758-7522592a1c7f response_code = 204 uri = /eip-gateways
25752024-11-21T19:43:18.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34642 req_id = a332b622-857e-404b-97c9-581b20012518 response_code = 204 uri = /vpc-routes
25762024-11-21T19:43:18.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43969
25772024-11-21T19:43:18.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43969 req_id = cad3b11d-6d31-4fde-af76-1a5d6e2670f3 response_code = 200 uri = /vpc-routes
25782024-11-21T19:43:18.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40545
25792024-11-21T19:43:18.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40545 req_id = f681ea25-21a8-47e4-9eda-4cc5f73d9a02 response_code = 200 uri = /v2p
25802024-11-21T19:43:18.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45849
25812024-11-21T19:43:18.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45849 req_id = 1bfa51a8-8e11-4a0b-ad5d-b91210e9e216 response_code = 200 uri = /v2p
25822024-11-21T19:43:18.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61888
25832024-11-21T19:43:18.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61888 req_id = 7517455b-fc32-4062-ab45-7b2673809fda response_code = 200 uri = /v2p
25842024-11-21T19:43:18.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53089
25852024-11-21T19:43:18.194ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25862024-11-21T19:43:18.252ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25872024-11-21T19:43:18.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141213 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53089 req_id = 0276b2a1-6c2a-45cb-b492-a8bccf06d73a response_code = 204 uri = /switch-ports
25882024-11-21T19:43:18.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41352
25892024-11-21T19:43:18.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38517
25902024-11-21T19:43:18.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34099
25912024-11-21T19:43:18.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44786
25922024-11-21T19:43:18.343ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25932024-11-21T19:43:18.343ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
25942024-11-21T19:43:18.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60952
25952024-11-21T19:43:18.343ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25962024-11-21T19:43:18.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7523 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43969 req_id = fcb4ec61-e818-498c-9c6a-616187f9099f response_code = 204 uri = /eip-gateways
25972024-11-21T19:43:18.343ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25982024-11-21T19:43:18.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7556 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53089 req_id = a7833334-b881-4d15-998d-51a2883e0ba9 response_code = 200 uri = /network-bootstore-config
25992024-11-21T19:43:18.343ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26002024-11-21T19:43:18.343ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26012024-11-21T19:43:18.343ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26022024-11-21T19:43:18.343ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26032024-11-21T19:43:18.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41352 req_id = a18f7be9-1655-44d5-97e5-65a42dcf36e2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26042024-11-21T19:43:18.343ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26052024-11-21T19:43:18.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60952 req_id = 45c6514d-46af-49c4-8d1a-83d49052b9c6 response_code = 200 uri = /vpc-routes
26062024-11-21T19:43:18.343ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26072024-11-21T19:43:18.343ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26082024-11-21T19:43:18.343ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json file = common/src/ledger.rs:178
26092024-11-21T19:43:18.344ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26102024-11-21T19:43:18.344ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json file = common/src/ledger.rs:178
26112024-11-21T19:43:18.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1067 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43969 req_id = 9c03ffa2-0ff8-4216-8320-56a4220077b5 response_code = 204 uri = /vpc-routes
26122024-11-21T19:43:18.373ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26132024-11-21T19:43:18.373ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_11d53b36-56c4-493b-908d-a4b25d43b82e
26142024-11-21T19:43:18.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26152024-11-21T19:43:18.397ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json file = common/src/ledger.rs:178
26162024-11-21T19:43:18.403ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26172024-11-21T19:43:18.411ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json file = common/src/ledger.rs:178
26182024-11-21T19:43:18.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47419
26192024-11-21T19:43:18.417ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26202024-11-21T19:43:18.417ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789
26212024-11-21T19:43:18.418ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26222024-11-21T19:43:18.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26232024-11-21T19:43:18.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26242024-11-21T19:43:18.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26252024-11-21T19:43:18.424ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26262024-11-21T19:43:18.424ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26272024-11-21T19:43:18.424ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26282024-11-21T19:43:18.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12883 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47419 req_id = 9569ccb7-6fcc-43f0-a171-1c53d9b4656d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26292024-11-21T19:43:18.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63634
26302024-11-21T19:43:18.439ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26312024-11-21T19:43:18.439ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_11d53b36-56c4-493b-908d-a4b25d43b82e
26322024-11-21T19:43:18.451ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
26332024-11-21T19:43:18.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60952 req_id = 6c6ade3b-4175-4e91-8da5-920536f0c0d8 response_code = 204 uri = /eip-gateways
26342024-11-21T19:43:18.461ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26352024-11-21T19:43:18.461ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26362024-11-21T19:43:18.461ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/config/omicron-zones.json file = common/src/ledger.rs:178
26372024-11-21T19:43:18.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7444 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60952 req_id = a8a265c8-3db3-4edd-a237-3754a2997b8d response_code = 204 uri = /vpc-routes
26382024-11-21T19:43:18.481ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26392024-11-21T19:43:18.481ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_784212b9-62b7-432d-b0d7-e4600fa06921
26402024-11-21T19:43:18.487ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/config/omicron-zones.json file = common/src/ledger.rs:178
26412024-11-21T19:43:18.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54405
26422024-11-21T19:43:18.499ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26432024-11-21T19:43:18.499ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789
26442024-11-21T19:43:18.504ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26452024-11-21T19:43:18.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160724 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44786 req_id = 12589222-1b67-4fcc-911f-1668081e23f8 response_code = 204 uri = /switch-ports
26462024-11-21T19:43:18.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44786 req_id = fffa87f3-85b9-4b7e-958d-865149492f2f response_code = 200 uri = /network-bootstore-config
26472024-11-21T19:43:18.518ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11d53b36-56c4-493b-908d-a4b25d43b82e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26482024-11-21T19:43:18.518ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_11d53b36-56c4-493b-908d-a4b25d43b82e
26492024-11-21T19:43:18.544ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26502024-11-21T19:43:18.544ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_21742b4e-23b7-43df-8530-fcf02dea3824
26512024-11-21T19:43:18.556ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26522024-11-21T19:43:18.562ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c2f13ae-cbfd-4d35-8cda-af591905c789 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26532024-11-21T19:43:18.562ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2c2f13ae-cbfd-4d35-8cda-af591905c789
26542024-11-21T19:43:18.577ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26552024-11-21T19:43:18.577ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_784212b9-62b7-432d-b0d7-e4600fa06921
26562024-11-21T19:43:18.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50113
26572024-11-21T19:43:18.592ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c211da9-c36c-41bc-8274-9aa6420c20e6, kind: Service { id: 90b200e8-d1ee-4e0d-975c-64628c5532d2 }, name: Name("external-dns-90b200e8-d1ee-4e0d-975c-64628c5532d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 185])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b69bf686-c443-40c6-b854-c2ff6e5e107a, kind: Service { id: 4e669ff4-6dde-4cd2-8491-623460b56d8d }, name: Name("external-dns-4e669ff4-6dde-4cd2-8491-623460b56d8d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 188])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03ccecdf-44ea-4815-8920-5ebe8d7bf7ff, kind: Service { id: 915e11b8-d7cb-4730-9906-7980540813dc }, name: Name("nexus-915e11b8-d7cb-4730-9906-7980540813dc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4cb2fda6-91fb-43d0-be7c-77f85347c432, kind: Service { id: 39d14e41-6d5d-474a-aaea-65c36b8f9da5 }, name: Name("nexus-39d14e41-6d5d-474a-aaea-65c36b8f9da5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 243])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e0b7555-efc0-41d1-b3ba-7ca41e2e30b7, kind: Service { id: 088dbd0f-363c-4785-9d04-aa968256294e }, name: Name("nexus-088dbd0f-363c-4785-9d04-aa968256294e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26582024-11-21T19:43:18.592ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26592024-11-21T19:43:18.592ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26602024-11-21T19:43:18.592ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26612024-11-21T19:43:18.592ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26622024-11-21T19:43:18.592ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26632024-11-21T19:43:18.592ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26642024-11-21T19:43:18.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50113 req_id = 6a56c588-8d29-4fc3-9a1a-f0d83366d07a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26652024-11-21T19:43:18.595ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26662024-11-21T19:43:18.596ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0
26672024-11-21T19:43:18.611ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26682024-11-21T19:43:18.611ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_21742b4e-23b7-43df-8530-fcf02dea3824
26692024-11-21T19:43:18.626ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 784212b9-62b7-432d-b0d7-e4600fa06921 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26702024-11-21T19:43:18.626ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_784212b9-62b7-432d-b0d7-e4600fa06921
26712024-11-21T19:43:18.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137839 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54405 req_id = 3646d0a7-98f6-4c9a-bc1f-7a551647d179 response_code = 204 uri = /switch-ports
26722024-11-21T19:43:18.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54405 req_id = 8bc1985f-63fc-4d42-b83b-95dba6a26340 response_code = 200 uri = /network-bootstore-config
26732024-11-21T19:43:18.645ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26742024-11-21T19:43:18.645ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_03f27c6c-e171-4450-8876-58f440dc9097
26752024-11-21T19:43:18.661ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 21742b4e-23b7-43df-8530-fcf02dea3824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26762024-11-21T19:43:18.661ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_21742b4e-23b7-43df-8530-fcf02dea3824
26772024-11-21T19:43:18.673ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26782024-11-21T19:43:18.673ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0
26792024-11-21T19:43:18.690ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26802024-11-21T19:43:18.690ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f
26812024-11-21T19:43:18.710ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26822024-11-21T19:43:18.710ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_03f27c6c-e171-4450-8876-58f440dc9097
26832024-11-21T19:43:18.722ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 61b32b1c-9218-4c36-b123-2959f1dfd4f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26842024-11-21T19:43:18.722ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_61b32b1c-9218-4c36-b123-2959f1dfd4f0
26852024-11-21T19:43:18.738ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26862024-11-21T19:43:18.739ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_695b40ec-ab62-486b-99a5-161c372e3934
26872024-11-21T19:43:18.760ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 03f27c6c-e171-4450-8876-58f440dc9097 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26882024-11-21T19:43:18.760ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_03f27c6c-e171-4450-8876-58f440dc9097
26892024-11-21T19:43:18.774ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26902024-11-21T19:43:18.774ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f
26912024-11-21T19:43:18.795ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26922024-11-21T19:43:18.796ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b36cfd4c-887e-4515-9f44-b45436c8de30
26932024-11-21T19:43:18.811ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26942024-11-21T19:43:18.811ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_695b40ec-ab62-486b-99a5-161c372e3934
26952024-11-21T19:43:18.823ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a7d01cd-9218-405e-81a7-0632ac6eff3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26962024-11-21T19:43:18.823ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8a7d01cd-9218-405e-81a7-0632ac6eff3f
26972024-11-21T19:43:18.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 483458 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38517 req_id = d5abf557-0003-4eae-b24a-8bd543f86e9e response_code = 200 uri = /inventory
26982024-11-21T19:43:18.846ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 695b40ec-ab62-486b-99a5-161c372e3934 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26992024-11-21T19:43:18.846ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_695b40ec-ab62-486b-99a5-161c372e3934
27002024-11-21T19:43:18.859ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27012024-11-21T19:43:18.859ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b36cfd4c-887e-4515-9f44-b45436c8de30
27022024-11-21T19:43:18.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528706 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34099 req_id = e39ea028-95ec-4c27-86da-984fdf6d853d response_code = 200 uri = /inventory
27032024-11-21T19:43:18.876ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b36cfd4c-887e-4515-9f44-b45436c8de30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27042024-11-21T19:43:18.876ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b36cfd4c-887e-4515-9f44-b45436c8de30
27052024-11-21T19:43:18.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 461718 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63634 req_id = 89133fdd-9e7c-4105-b856-352c2c506dc5 response_code = 200 uri = /inventory
27062024-11-21T19:43:26.757ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27072024-11-21T19:43:26.789ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27082024-11-21T19:43:26.793ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27092024-11-21T19:43:26.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27102024-11-21T19:43:36.761ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27112024-11-21T19:43:36.791ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27122024-11-21T19:43:36.795ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27132024-11-21T19:43:36.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27142024-11-21T19:43:37.293ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65449
27152024-11-21T19:43:37.293ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65449 req_id = 7a173aa9-653a-4c9a-9166-7928acc4426e response_code = 200 uri = /baseboard
27162024-11-21T19:43:46.766ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27172024-11-21T19:43:46.794ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27182024-11-21T19:43:46.797ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27192024-11-21T19:43:46.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27202024-11-21T19:43:47.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44362
27212024-11-21T19:43:47.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44362 req_id = 889d466a-a8af-4708-a587-ddba26eebf8b response_code = 200 uri = /vpc-routes
27222024-11-21T19:43:47.783ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
27232024-11-21T19:43:47.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44362 req_id = 5109a5f7-b925-4482-8e87-bd1109072b3d response_code = 204 uri = /eip-gateways
27242024-11-21T19:43:47.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44362 req_id = 4c6684d1-0045-4608-b824-465632279b92 response_code = 204 uri = /vpc-routes
27252024-11-21T19:43:47.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40989
27262024-11-21T19:43:47.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40989 req_id = 0cf605d9-ac0a-4cb5-9ae8-5d2e3cda9cbb response_code = 200 uri = /vpc-routes
27272024-11-21T19:43:47.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64730
27282024-11-21T19:43:47.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64730 req_id = 5974729d-441d-42d8-a296-5a487268c83c response_code = 200 uri = /v2p
27292024-11-21T19:43:47.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48983
27302024-11-21T19:43:47.895ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27312024-11-21T19:43:47.939ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27322024-11-21T19:43:48.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48983 req_id = 30ec26ef-36a6-4fc4-929c-d3cd77712044 response_code = 204 uri = /switch-ports
27332024-11-21T19:43:48.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37355
27342024-11-21T19:43:48.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35438
27352024-11-21T19:43:48.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62181
27362024-11-21T19:43:48.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48983 req_id = 63b803e0-1e76-49d3-8ba3-5df88890c57c response_code = 200 uri = /network-bootstore-config
27372024-11-21T19:43:48.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
27382024-11-21T19:43:48.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40989 req_id = 8db44311-ca82-4860-bcb7-1067644bd5da response_code = 204 uri = /eip-gateways
27392024-11-21T19:43:48.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35438 req_id = c25fbb64-ccbb-4a29-87a9-df01aab86824 response_code = 200 uri = /vpc-routes
27402024-11-21T19:43:48.002ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27412024-11-21T19:43:48.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37355 req_id = 4016d2f1-5cbe-4d73-805a-7238686fba86 response_code = 200 uri = /v2p
27422024-11-21T19:43:48.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40989 req_id = 7970e087-ff62-4f36-bd05-b4a758137882 response_code = 204 uri = /vpc-routes
27432024-11-21T19:43:48.043ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
27442024-11-21T19:43:48.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35438 req_id = 6773b78a-b967-4c2f-99f2-b812cb3bf3c6 response_code = 204 uri = /eip-gateways
27452024-11-21T19:43:48.050ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27462024-11-21T19:43:48.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 915 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35438 req_id = 990438d5-2e86-441e-b4a7-9c96f2ff09cd response_code = 204 uri = /vpc-routes
27472024-11-21T19:43:48.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40460
27482024-11-21T19:43:48.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40460 req_id = 218b1285-48a2-416c-b852-553d0fbba57e response_code = 200 uri = /v2p
27492024-11-21T19:43:48.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109811 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62181 req_id = a04de9e1-711c-45c4-829a-20853db9c37a response_code = 204 uri = /switch-ports
27502024-11-21T19:43:48.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62181 req_id = cd23db72-4672-45b3-bfc3-adcbea496dd1 response_code = 200 uri = /network-bootstore-config
27512024-11-21T19:43:48.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46384
27522024-11-21T19:43:48.175ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27532024-11-21T19:43:48.214ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27542024-11-21T19:43:48.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99677 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46384 req_id = 55712137-3d0c-40c2-aabc-9eff8fb5b7ab response_code = 204 uri = /switch-ports
27552024-11-21T19:43:48.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46384 req_id = 28ce3e6b-6d8a-43a3-a261-c5adec39ad6e response_code = 200 uri = /network-bootstore-config
27562024-11-21T19:43:56.770ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27572024-11-21T19:43:56.795ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27582024-11-21T19:43:56.799ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27592024-11-21T19:43:56.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27602024-11-21T19:44:06.774ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27612024-11-21T19:44:06.798ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27622024-11-21T19:44:06.801ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27632024-11-21T19:44:06.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27642024-11-21T19:44:07.326ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60271
27652024-11-21T19:44:07.326ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60271 req_id = dcbe9e6d-760b-4dbd-a559-8d92c399ba02 response_code = 200 uri = /baseboard
27662024-11-21T19:44:16.778ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27672024-11-21T19:44:16.799ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27682024-11-21T19:44:16.803ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27692024-11-21T19:44:16.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
27702024-11-21T19:44:17.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63072
27712024-11-21T19:44:17.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63072 req_id = 8fb64ce0-2c8a-4675-abed-4cdeeb6428a1 response_code = 200 uri = /vpc-routes
27722024-11-21T19:44:18.005ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
27732024-11-21T19:44:18.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63072 req_id = bd98bf3d-d14c-48ae-ab58-575d28719cd8 response_code = 204 uri = /eip-gateways
27742024-11-21T19:44:18.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63072 req_id = b050a134-7a3c-45c0-8842-9266cc0be774 response_code = 204 uri = /vpc-routes
27752024-11-21T19:44:18.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54812
27762024-11-21T19:44:18.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54812 req_id = ad2bf790-78eb-41f2-887d-1a881a5d65be response_code = 200 uri = /v2p
27772024-11-21T19:44:18.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61021
27782024-11-21T19:44:18.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61021 req_id = 387fa764-6c1f-402f-8d35-8d29f1c7fb7b response_code = 200 uri = /vpc-routes
27792024-11-21T19:44:18.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33417
27802024-11-21T19:44:18.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27812024-11-21T19:44:18.158ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27822024-11-21T19:44:18.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33417 req_id = 2320bc3f-1fd0-4c9e-8d33-a021191f4281 response_code = 204 uri = /switch-ports
27832024-11-21T19:44:18.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48927
27842024-11-21T19:44:18.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47902
27852024-11-21T19:44:18.222ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
27862024-11-21T19:44:18.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61021 req_id = 98e13e0c-9631-47c9-b689-693285aa6fb4 response_code = 204 uri = /eip-gateways
27872024-11-21T19:44:18.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54984
27882024-11-21T19:44:18.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55849
27892024-11-21T19:44:18.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33417 req_id = 530ed695-69aa-42d4-b58a-f225510a704a response_code = 200 uri = /network-bootstore-config
27902024-11-21T19:44:18.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47902 req_id = 5380ea6b-6230-43de-8f21-326a377ca506 response_code = 200 uri = /vpc-routes
27912024-11-21T19:44:18.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55849 req_id = d06e4b96-7b6b-4c51-a1b0-d5690be576a7 response_code = 200 uri = /v2p
27922024-11-21T19:44:18.222ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27932024-11-21T19:44:18.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 613 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54984 req_id = 306b014d-2b08-433d-a994-6d47ab26567f response_code = 200 uri = /v2p
27942024-11-21T19:44:18.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61021 req_id = 73893282-3bb4-45ec-a1a9-b558c01d9fa8 response_code = 204 uri = /vpc-routes
27952024-11-21T19:44:18.237ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
27962024-11-21T19:44:18.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47902 req_id = 6de62d45-4779-43f1-a1a5-6fd2c04a8d9c response_code = 204 uri = /eip-gateways
27972024-11-21T19:44:18.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 580 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47902 req_id = 2a2d4d5c-4464-432c-83d8-ed6b7db1b005 response_code = 204 uri = /vpc-routes
27982024-11-21T19:44:18.271ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27992024-11-21T19:44:18.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48927 req_id = cd73f045-4116-4238-9917-12b9e109a6f9 response_code = 204 uri = /switch-ports
28002024-11-21T19:44:18.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48927 req_id = 9e0beae1-cf92-47e1-85b9-732830c66430 response_code = 200 uri = /network-bootstore-config
28012024-11-21T19:44:18.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38425
28022024-11-21T19:44:18.423ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28032024-11-21T19:44:18.460ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28042024-11-21T19:44:18.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100065 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38425 req_id = 0b9716b7-cb21-4d83-9fea-dd448703a991 response_code = 204 uri = /switch-ports
28052024-11-21T19:44:18.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38425 req_id = 625e7889-5259-40a1-bcb2-3bc304aeb9e0 response_code = 200 uri = /network-bootstore-config
28062024-11-21T19:44:26.782ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28072024-11-21T19:44:26.802ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28082024-11-21T19:44:26.805ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28092024-11-21T19:44:26.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28102024-11-21T19:44:36.786ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28112024-11-21T19:44:36.804ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28122024-11-21T19:44:36.807ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28132024-11-21T19:44:36.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28142024-11-21T19:44:37.361ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49345
28152024-11-21T19:44:37.361ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49345 req_id = e8ed365d-a97c-45e9-b5df-70ecca956b39 response_code = 200 uri = /baseboard
28162024-11-21T19:44:46.790ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28172024-11-21T19:44:46.806ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28182024-11-21T19:44:46.809ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28192024-11-21T19:44:46.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28202024-11-21T19:44:47.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46103
28212024-11-21T19:44:47.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46103 req_id = cd23d67a-0b1e-4c27-8ac1-fea43520d792 response_code = 200 uri = /vpc-routes
28222024-11-21T19:44:47.778ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
28232024-11-21T19:44:47.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46103 req_id = abee5a8b-6c55-49e2-8735-5b78a08ab925 response_code = 204 uri = /eip-gateways
28242024-11-21T19:44:47.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46103 req_id = 877b58c8-e848-40e5-9472-9a533875481e response_code = 204 uri = /vpc-routes
28252024-11-21T19:44:47.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60517
28262024-11-21T19:44:47.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60517 req_id = 38cc522d-e43d-43a2-9746-67ffb78a792b response_code = 200 uri = /vpc-routes
28272024-11-21T19:44:47.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33172
28282024-11-21T19:44:47.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33172 req_id = 0a343765-31f0-4dea-9d02-42532014c83a response_code = 200 uri = /v2p
28292024-11-21T19:44:47.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46235
28302024-11-21T19:44:47.911ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28312024-11-21T19:44:47.961ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28322024-11-21T19:44:48.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117406 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46235 req_id = 80461d22-0b4b-4659-a83f-fc43de16e259 response_code = 204 uri = /switch-ports
28332024-11-21T19:44:48.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59044
28342024-11-21T19:44:48.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
28352024-11-21T19:44:48.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60517 req_id = 7ab402a4-9258-461e-9b4e-7071f61a961e response_code = 204 uri = /eip-gateways
28362024-11-21T19:44:48.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59044 req_id = fa280388-cc4a-4ed8-83d5-b517f7a02b88 response_code = 200 uri = /vpc-routes
28372024-11-21T19:44:48.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46235 req_id = c89f90fa-b3db-4299-8503-4184d290667c response_code = 200 uri = /network-bootstore-config
28382024-11-21T19:44:48.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53869
28392024-11-21T19:44:48.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53869 req_id = 99e033ea-a604-4710-afc4-fa3448a11d94 response_code = 200 uri = /v2p
28402024-11-21T19:44:48.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60517 req_id = 32733d68-47e6-4de2-bb1e-a28d32332b5a response_code = 204 uri = /vpc-routes
28412024-11-21T19:44:48.071ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
28422024-11-21T19:44:48.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59044 req_id = e889e3d5-6bfc-476b-8cec-2d5250d3c431 response_code = 204 uri = /eip-gateways
28432024-11-21T19:44:48.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51833
28442024-11-21T19:44:48.076ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28452024-11-21T19:44:48.119ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28462024-11-21T19:44:48.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104254 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51833 req_id = a0584311-f40e-40c7-b69d-da59d12c601e response_code = 204 uri = /switch-ports
28472024-11-21T19:44:48.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51701
28482024-11-21T19:44:48.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28492024-11-21T19:44:48.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3813 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59044 req_id = c3de0d9d-a658-44e0-8f60-b799814731e5 response_code = 204 uri = /vpc-routes
28502024-11-21T19:44:48.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51833 req_id = 9c487638-161a-429c-ba5a-b087dda55607 response_code = 200 uri = /network-bootstore-config
28512024-11-21T19:44:48.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39392
28522024-11-21T19:44:48.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39392 req_id = ca7efe22-1d43-414e-96b1-200a0518a975 response_code = 200 uri = /v2p
28532024-11-21T19:44:48.220ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28542024-11-21T19:44:48.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51701 req_id = e84e3c12-ec30-41ae-b349-488bfc3a1ee2 response_code = 204 uri = /switch-ports
28552024-11-21T19:44:48.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51701 req_id = e5e9eaf0-5e42-4f7d-b272-118d2578aea5 response_code = 200 uri = /network-bootstore-config
28562024-11-21T19:44:56.795ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28572024-11-21T19:44:56.809ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28582024-11-21T19:44:56.812ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28592024-11-21T19:44:56.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28602024-11-21T19:44:57.491ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
28612024-11-21T19:45:00.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62922
28622024-11-21T19:45:00.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62922 req_id = 034663f3-846f-4859-a286-7eac93ef2b6c response_code = 200 uri = /v2p
28632024-11-21T19:45:00.669ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14005037) }
28642024-11-21T19:45:00.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62922 req_id = d83267c9-4dc2-4f8a-a1de-a991c3162270 response_code = 204 uri = /v2p
28652024-11-21T19:45:00.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51699
28662024-11-21T19:45:00.908ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: da5e4476-3bbb-4b01-9c62-0fd7818d2064, kind: Instance { id: 6cfe5dca-4126-4d42-8675-cbf523b12f57 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14005037), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: da5e4476-3bbb-4b01-9c62-0fd7818d2064, kind: Instance { id: 6cfe5dca-4126-4d42-8675-cbf523b12f57 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14005037), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: da5e4476-3bbb-4b01-9c62-0fd7818d2064, kind: Instance { id: 6cfe5dca-4126-4d42-8675-cbf523b12f57 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14005037), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14005037))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: da5e4476-3bbb-4b01-9c62-0fd7818d2064, kind: Instance { id: 6cfe5dca-4126-4d42-8675-cbf523b12f57 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14005037), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-71b8bea054a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9ddac72d-c75d-4a69-b532-6a788fc29951, read_only_parent: Some(Volume { block_size: 512, id: da5abb0b-9620-47d3-a8a7-8842ec0dd47a, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ec15ea7f-983e-46a2-88da-3fc00739a880, key: Some("/A29ob3jo1KgJdqQp6XGFVfPr0qvSAGKOyk1wwq0zvU="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9ddac72d-c75d-4a69-b532-6a788fc29951, key: Some("vddc6Ax7k3fKd16ouZUcAqunB5OTFSNF7V5L0SU26/o="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::19]:19003", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-71b8bea054a" }] }), cloud_init_bytes: Some(..) } instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 metadata = InstanceMetadata { silo_id: 4d2571c7-98ea-428d-998e-b26e88b12e96, project_id: c812f686-a95a-4166-92d9-d8d73d9ff82b } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-21T19:45:00.900004529Z }
28672024-11-21T19:45:00.908ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 migration_id = None propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28682024-11-21T19:45:00.909ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 migration_id = None propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: da5e4476-3bbb-4b01-9c62-0fd7818d2064, kind: Instance { id: 6cfe5dca-4126-4d42-8675-cbf523b12f57 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14005037), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: da5e4476-3bbb-4b01-9c62-0fd7818d2064, kind: Instance { id: 6cfe5dca-4126-4d42-8675-cbf523b12f57 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14005037), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: da5e4476-3bbb-4b01-9c62-0fd7818d2064, kind: Instance { id: 6cfe5dca-4126-4d42-8675-cbf523b12f57 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14005037), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14005037))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: da5e4476-3bbb-4b01-9c62-0fd7818d2064, kind: Instance { id: 6cfe5dca-4126-4d42-8675-cbf523b12f57 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14005037), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-71b8bea054a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9ddac72d-c75d-4a69-b532-6a788fc29951, read_only_parent: Some(Volume { block_size: 512, id: da5abb0b-9620-47d3-a8a7-8842ec0dd47a, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ec15ea7f-983e-46a2-88da-3fc00739a880, key: Some("/A29ob3jo1KgJdqQp6XGFVfPr0qvSAGKOyk1wwq0zvU="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9ddac72d-c75d-4a69-b532-6a788fc29951, key: Some("vddc6Ax7k3fKd16ouZUcAqunB5OTFSNF7V5L0SU26/o="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::19]:19003", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-71b8bea054a" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-21T19:45:00.900004529Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28692024-11-21T19:45:00.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8985 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51699 req_id = c0a59dc9-514d-4f95-85fa-e1c5baf1548b response_code = 200 uri = /vmms/d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28702024-11-21T19:45:01.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64536
28712024-11-21T19:45:01.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 696 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64536 req_id = d8292edb-268c-493f-834b-8f5d2261ada8 response_code = 200 uri = /vmms/d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736/state
28722024-11-21T19:45:01.058ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 14005037 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28732024-11-21T19:45:01.059ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28742024-11-21T19:45:01.130ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 file = illumos-utils/src/zone.rs:325 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28752024-11-21T19:45:01.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36657
28762024-11-21T19:45:01.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36657 req_id = 67adad1a-7732-46ed-aada-20e20295433b response_code = 200 uri = /vpc-routes
28772024-11-21T19:45:01.172ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 file = illumos-utils/src/zone.rs:363 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28782024-11-21T19:45:01.184ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {da5e4476-3bbb-4b01-9c62-0fd7818d2064: {10.151.1.175: {234c2ba7-3586-4d9d-ac48-1e1ba410cdec}, 10.151.1.176: {234c2ba7-3586-4d9d-ac48-1e1ba410cdec}}} }
28792024-11-21T19:45:02.821ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28802024-11-21T19:45:02.822ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28812024-11-21T19:45:03.090ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 25.220767ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28822024-11-21T19:45:03.127ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 103.276115ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28832024-11-21T19:45:03.253ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 182.348874ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28842024-11-21T19:45:03.458ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 559.453846ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28852024-11-21T19:45:04.031ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 794.822542ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28862024-11-21T19:45:04.839ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 995.601974ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28872024-11-21T19:45:05.849ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 1.016968691s file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28882024-11-21T19:45:06.799ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28892024-11-21T19:45:06.811ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28902024-11-21T19:45:06.813ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28912024-11-21T19:45:06.880ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 521.566819ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28922024-11-21T19:45:06.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
28932024-11-21T19:45:07.395ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44038
28942024-11-21T19:45:07.396ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44038 req_id = 181ab6b0-174c-473d-81c6-0f1e5aa020b8 response_code = 200 uri = /baseboard
28952024-11-21T19:45:07.416ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 562.871854ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 zone = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28962024-11-21T19:45:08.010ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 file = sled-agent/src/instance.rs:1787 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28972024-11-21T19:45:08.020ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 55.288891ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28982024-11-21T19:45:08.089ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 51.868025ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
28992024-11-21T19:45:08.154ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 207.31006ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29002024-11-21T19:45:08.375ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736") failed: Property not found. retry in 532.740082ms file = illumos-utils/src/svc.rs:36 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29012024-11-21T19:45:08.923ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29022024-11-21T19:45:08.960ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29032024-11-21T19:45:09.110ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29042024-11-21T19:45:09.111ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
29052024-11-21T19:45:09.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7926842 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36657 req_id = d34ae10e-f4eb-4987-b22a-44965aa3db65 response_code = 204 uri = /eip-gateways
29062024-11-21T19:45:09.111ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-21T19:45:09.111539652Z } file = sled-agent/src/instance.rs:780 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29072024-11-21T19:45:09.111ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-21T19:45:09.111539652Z } propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29082024-11-21T19:45:09.111ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-21T19:45:09.111539652Z }, migration_in: None, migration_out: None }
29092024-11-21T19:45:09.136ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-21T19:45:09.136692848Z } file = sled-agent/src/instance.rs:780 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29102024-11-21T19:45:09.136ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-21T19:45:09.136692848Z } propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29112024-11-21T19:45:09.136ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-21T19:45:09.136692848Z }, migration_in: None, migration_out: None }
29122024-11-21T19:45:09.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 423 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36657 req_id = 73d7ce50-cdae-41d2-9d2a-7ed5fa04fe34 response_code = 204 uri = /vpc-routes
29132024-11-21T19:45:16.802ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
29142024-11-21T19:45:16.812ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
29152024-11-21T19:45:16.815ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
29162024-11-21T19:45:16.952ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
29172024-11-21T19:45:17.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41580
29182024-11-21T19:45:17.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 818 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41580 req_id = d4b5de97-01ce-4d11-b32a-39a17b5df031 response_code = 200 uri = /vmms/d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736/state
29192024-11-21T19:45:17.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40732
29202024-11-21T19:45:17.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40732 req_id = 924ffb53-ae96-45ac-8f0e-387f8b6553ae response_code = 200 uri = /vpc-routes
29212024-11-21T19:45:18.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39386
29222024-11-21T19:45:18.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39386 req_id = 15a7a558-bb98-4f67-9148-24c7a70409f5 response_code = 200 uri = /vmms/d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736/state
29232024-11-21T19:45:18.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36405
29242024-11-21T19:45:18.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36405 req_id = 5e4cc3a5-0624-46db-be20-68ddfa489ba5 response_code = 200 uri = /vpc-routes
29252024-11-21T19:45:18.122ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {da5e4476-3bbb-4b01-9c62-0fd7818d2064: {10.151.1.175: {234c2ba7-3586-4d9d-ac48-1e1ba410cdec}, 10.151.1.176: {234c2ba7-3586-4d9d-ac48-1e1ba410cdec}}} }
29262024-11-21T19:45:18.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36405 req_id = 8a755897-6b4e-498b-bac2-bc1d1110bb65 response_code = 204 uri = /eip-gateways
29272024-11-21T19:45:18.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36405 req_id = 3804446d-3baf-4c04-ae17-87c297a01241 response_code = 204 uri = /vpc-routes
29282024-11-21T19:45:18.149ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {da5e4476-3bbb-4b01-9c62-0fd7818d2064: {10.151.1.175: {234c2ba7-3586-4d9d-ac48-1e1ba410cdec}, 10.151.1.176: {234c2ba7-3586-4d9d-ac48-1e1ba410cdec}}} }
29292024-11-21T19:45:18.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40732 req_id = 86e21e3c-b7aa-4d3b-8e56-2d4a9db21b5d response_code = 204 uri = /eip-gateways
29302024-11-21T19:45:18.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63263
29312024-11-21T19:45:18.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63263 req_id = c7864b9e-d55b-4ee6-8a08-1387e203e7c8 response_code = 200 uri = /v2p
29322024-11-21T19:45:18.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40732 req_id = e47eda22-19d5-4653-83ba-c81ee21bdb7e response_code = 204 uri = /vpc-routes
29332024-11-21T19:45:18.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55957
29342024-11-21T19:45:18.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55957 req_id = 28694373-8f7a-4280-8d77-0ad88c775ec3 response_code = 200 uri = /v2p
29352024-11-21T19:45:18.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52597
29362024-11-21T19:45:18.262ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29372024-11-21T19:45:18.308ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29382024-11-21T19:45:18.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52597 req_id = 8b059956-3cc2-46b6-b44e-348d91f8749e response_code = 204 uri = /switch-ports
29392024-11-21T19:45:18.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42622
29402024-11-21T19:45:18.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50401
29412024-11-21T19:45:18.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50963
29422024-11-21T19:45:18.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52597 req_id = 9060d480-4b4f-4901-9918-052a14a51378 response_code = 200 uri = /network-bootstore-config
29432024-11-21T19:45:18.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50963 req_id = 706cde16-0709-46eb-839a-3c266e71ea7b response_code = 200 uri = /vpc-routes
29442024-11-21T19:45:18.379ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29452024-11-21T19:45:18.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50401 req_id = 6408ca1f-c0af-4800-a3df-c3b26ddf0fb6 response_code = 200 uri = /vmms/d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736/state
29462024-11-21T19:45:18.430ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {da5e4476-3bbb-4b01-9c62-0fd7818d2064: {10.151.1.176: {234c2ba7-3586-4d9d-ac48-1e1ba410cdec}, 10.151.1.175: {234c2ba7-3586-4d9d-ac48-1e1ba410cdec}}} }
29472024-11-21T19:45:18.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50963 req_id = abe7c8b4-009b-4c63-83fd-ab074c52cdd8 response_code = 204 uri = /eip-gateways
29482024-11-21T19:45:18.431ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29492024-11-21T19:45:18.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 882 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50963 req_id = ae764ca2-0a26-4605-ad85-a58ffc896be6 response_code = 204 uri = /vpc-routes
29502024-11-21T19:45:18.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48959
29512024-11-21T19:45:18.506ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29522024-11-21T19:45:18.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127585 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42622 req_id = fb701642-6b6b-4332-a03f-6bc9af5a3340 response_code = 204 uri = /switch-ports
29532024-11-21T19:45:18.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 739 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42622 req_id = 7733845f-9845-4857-8e85-8272b5498db5 response_code = 200 uri = /network-bootstore-config
29542024-11-21T19:45:18.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60002
29552024-11-21T19:45:18.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60002 req_id = 5af14627-e7cb-485e-9149-5bed78309783 response_code = 200 uri = /v2p
29562024-11-21T19:45:18.549ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29572024-11-21T19:45:18.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123701 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48959 req_id = 9b7c40e5-b328-4cee-b554-1e8c339c2c78 response_code = 204 uri = /switch-ports
29582024-11-21T19:45:18.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48959 req_id = 5ea58a4d-6c9b-49a7-874d-83dffe6fa607 response_code = 200 uri = /network-bootstore-config
29592024-11-21T19:45:18.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59982
29602024-11-21T19:45:18.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59982 req_id = d9b57931-ef6b-4769-895a-1af5a9ae8ce1 response_code = 200 uri = /vmms/d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736/state
29612024-11-21T19:45:18.889ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-21T19:45:18.889295650Z } file = sled-agent/src/instance.rs:780 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29622024-11-21T19:45:18.889ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-21T19:45:18.889295650Z } propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29632024-11-21T19:45:18.889ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-21T19:45:18.889295650Z }, migration_in: None, migration_out: None }
29642024-11-21T19:45:18.929ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-21T19:45:18.929964134Z } file = sled-agent/src/instance.rs:780 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29652024-11-21T19:45:18.930ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-21T19:45:18.929964134Z } propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29662024-11-21T19:45:18.930ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29672024-11-21T19:45:18.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29682024-11-21T19:45:18.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29692024-11-21T19:45:18.930ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/20e2b049-cfc5-4dbe-a0ef-d3766051460d/debug/bundle/zone", "/pool/int/996782d1-dad1-4047-aff6-e695ddfee4b7/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/11d53b36-56c4-493b-908d-a4b25d43b82e/crypt/debug", "/pool/ext/2c2f13ae-cbfd-4d35-8cda-af591905c789/crypt/debug", "/pool/ext/784212b9-62b7-432d-b0d7-e4600fa06921/crypt/debug", "/pool/ext/21742b4e-23b7-43df-8530-fcf02dea3824/crypt/debug", "/pool/ext/61b32b1c-9218-4c36-b123-2959f1dfd4f0/crypt/debug", "/pool/ext/03f27c6c-e171-4450-8876-58f440dc9097/crypt/debug", "/pool/ext/8a7d01cd-9218-405e-81a7-0632ac6eff3f/crypt/debug", "/pool/ext/695b40ec-ab62-486b-99a5-161c372e3934/crypt/debug", "/pool/ext/b36cfd4c-887e-4515-9f44-b45436c8de30/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29702024-11-21T19:45:19.612ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736", bundle_id: 9422e121-2500-4af3-928f-be9dcb44b008 }, time_created: 2024-11-21T19:45:18.932104472Z, version: 0, cause: TerminatedInstance }
29712024-11-21T19:45:19.612ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 file = sled-agent/src/instance.rs:1032 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29722024-11-21T19:45:21.383ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29732024-11-21T19:45:21.402ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(14005037), kind: System }
29742024-11-21T19:45:21.402ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(14005037), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29752024-11-21T19:45:21.402ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-21T19:45:21.402783143Z }, migration_in: None, migration_out: None }
29762024-11-21T19:45:21.425ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-21T19:45:21.402783143Z }, migration_in: None, migration_out: None }
29772024-11-21T19:45:21.429ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 6cfe5dca-4126-4d42-8675-cbf523b12f57 propolis_id = d9f6a5d7-2a33-4d2f-9e23-4cb70fdcb736
29782024-11-21T19:45:21.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50731
29792024-11-21T19:45:21.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50731 req_id = acf4ad79-46fc-4f37-8cf6-98be4e5916ff response_code = 200 uri = /vpc-routes
29802024-11-21T19:45:21.874ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
29812024-11-21T19:45:21.874ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c
29822024-11-21T19:45:21.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50731 req_id = a669af7a-d5a4-47ac-87f5-b32f7d44026c response_code = 204 uri = /eip-gateways
29832024-11-21T19:45:21.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50731 req_id = a594e11b-1228-45bd-ab5b-65898eace4f6 response_code = 204 uri = /vpc-routes
29842024-11-21T19:45:22.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57311
29852024-11-21T19:45:22.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57311 req_id = 0e7e8537-c369-4949-90ee-71d935b394be response_code = 200 uri = /v2p
29862024-11-21T19:45:22.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44461
29872024-11-21T19:45:22.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44461 req_id = f8e95166-21e9-4251-8d2e-ac006067745f response_code = 200 uri = /v2p
29882024-11-21T19:45:22.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56346
29892024-11-21T19:45:22.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56346 req_id = adaed946-e73e-408d-b95e-7677f9f5eea6 response_code = 200 uri = /vpc-routes
29902024-11-21T19:45:22.510ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
29912024-11-21T19:45:22.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56346 req_id = e4b53239-17c7-4c0b-a79c-bc9d2ed65606 response_code = 204 uri = /eip-gateways
29922024-11-21T19:45:22.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56346 req_id = 5e34f57d-a2bc-4adf-a842-8af70c6d7e11 response_code = 204 uri = /vpc-routes
29932024-11-21T19:45:23.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63078
29942024-11-21T19:45:23.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63078 req_id = c6a16f2c-9b8d-4669-b0ca-7286751fdae3 response_code = 200 uri = /vpc-routes
29952024-11-21T19:45:23.288ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 203795ed-576b-40e4-bed8-7463e3f2162c values = ExternalIpGatewayMap { mappings: {} }
29962024-11-21T19:45:23.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63078 req_id = 2eef67c3-4463-4e78-8087-65822ea30092 response_code = 204 uri = /eip-gateways
29972024-11-21T19:45:23.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63078 req_id = 4ecc7b46-6534-43e1-94fe-1d059cb959a7 response_code = 204 uri = /vpc-routes