Max level shown:
1 [ Dec 6 02:39:35 Enabled. ]
2 [ Dec 6 02:39:35 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 6 02:39:35 Method "start" exited with status 0. ]
4 [ Dec 6 02:39:35 Rereading configuration. ]
5 [ Dec 6 02:39:35 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-06T02:39:35.665ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-06T02:39:35.665ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-06T02:39:35.717ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-06T02:39:35.717ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-06T02:39:35.831ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-06T02:39:35.840ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-06T02:39:35.848ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-06T02:39:36.446ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-12-06T02:39:36.586ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-06T02:39:36.586ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-06T02:39:36.586ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-06T02:39:36.586ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-06T02:39:36.586ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-06T02:39:36.586ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-06T02:39:36.589ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-06T02:39:36.589ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-06T02:39:36.590ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-06T02:39:36.590ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-06T02:39:36.590ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-06T02:39:36.590ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-06T02:39:36.590ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-12-06T02:39:36.590ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-06T02:39:36.590ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-06T02:39:36.602ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-06T02:39:36.602ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 3a67b500-470e-4683-b94c-e71013ff45af (zpool)
322024-12-06T02:39:36.726ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal }
332024-12-06T02:39:37.283ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-12-06T02:39:37.283ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-06T02:39:37.283ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-06T02:39:37.283ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-06T02:39:37.283ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-12-06T02:39:37.285ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-06T02:39:37.285ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-06T02:39:37.292ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-06T02:39:37.292ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool)
422024-12-06T02:39:37.399ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal }
432024-12-06T02:39:37.956ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-06T02:39:37.956ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-06T02:39:37.956ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-06T02:39:37.956ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-06T02:39:37.956ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-12-06T02:39:37.956ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-06T02:39:37.956ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
502024-12-06T02:39:37.956ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
512024-12-06T02:39:37.956ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-06T02:39:37.956ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-06T02:39:37.956ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-12-06T02:39:37.956ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-06T02:39:37.956ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-06T02:39:37.956ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-06T02:39:37.956ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-12-06T02:39:37.956ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592024-12-06T02:39:37.956ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
602024-12-06T02:39:37.956ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-12-06T02:39:37.957ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-06T02:39:37.957ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-06T02:39:37.957ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
642024-12-06T02:39:37.957ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-06T02:39:37.957ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-06T02:39:37.957ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-06T02:39:37.957ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-12-06T02:39:37.957ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-06T02:39:37.957ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-06T02:39:37.957ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-06T02:39:37.957ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-12-06T02:39:37.957ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-06T02:39:37.957ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-06T02:39:37.957ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-12-06T02:39:37.957ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-12-06T02:39:37.957ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-06T02:39:37.957ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-06T02:39:37.957ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-12-06T02:39:37.957ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882024-12-06T02:39:37.957ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-06T02:39:37.957ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-06T02:39:37.957ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-12-06T02:39:37.957ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942024-12-06T02:39:37.957ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-06T02:39:37.957ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-06T02:39:37.957ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-06T02:39:37.957ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-06T02:39:37.957ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-06T02:39:37.957ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-12-06T02:39:37.957ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-06T02:39:37.957ZINFOSledAgent (bootstore): No ledger in /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-12-06T02:39:37.957ZINFOSledAgent (bootstore): No ledger in /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-12-06T02:39:37.957ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-12-06T02:39:37.957ZINFOSledAgent (bootstore): No ledger in /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-12-06T02:39:37.957ZINFOSledAgent (bootstore): No ledger in /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-12-06T02:39:37.957ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-12-06T02:39:37.957ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-06T02:39:37.957ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-06T02:39:37.969ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-12-06T02:39:37.969ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 6126, tv_nsec: 488048374 } time_to_next_cleanup = 599.999910247s
1142024-12-06T02:39:37.969ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-12-06T02:39:37.969ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-12-06T02:39:37.969ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-06T02:39:37.969ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-06T02:39:37.972ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-12-06T02:39:37.973ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-12-06T02:39:37.974ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-06T02:39:37.974ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-06T02:39:37.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-12-06T02:39:37.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1242024-12-06T02:39:37.974ZINFOSledAgent (RSS): No ledger in /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-06T02:39:37.974ZINFOSledAgent (RSS): No ledger in /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-06T02:39:37.974ZINFOSledAgent (RSS): No ledger in /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-06T02:39:37.974ZINFOSledAgent (RSS): No ledger in /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-06T02:39:37.974ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-06T02:39:37.974ZINFOSledAgent (RSS): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-06T02:39:37.974ZINFOSledAgent (RSS): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-06T02:39:37.974ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-06T02:39:37.974ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-06T02:39:37.974ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-06T02:39:37.974ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-06T02:39:37.974ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362024-12-06T02:39:37.974ZINFOSledAgent (bootstore): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372024-12-06T02:39:37.975ZINFOSledAgent (bootstore): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382024-12-06T02:39:37.975ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392024-12-06T02:39:37.975ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 5455a27f-b1dd-4d8d-adde-726221dabebe (sled), rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402024-12-06T02:39:37.975ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412024-12-06T02:39:37.975ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422024-12-06T02:39:37.980ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-06T02:39:37.986ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-06T02:39:37.986ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-06T02:39:37.991ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-06T02:39:37.991ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-06T02:39:37.991ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58567
1482024-12-06T02:39:37.991ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 5455a27f-b1dd-4d8d-adde-726221dabebe (sled), rack_id: fa39b2e1-03c3-48c1-8086-8e14b63b0d10, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-06T02:39:37.991ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-06T02:39:37.991ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-06T02:39:37.991ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-06T02:39:37.991ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1532024-12-06T02:39:37.991ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1542024-12-06T02:39:37.991ZINFOSledAgent (StorageManager): No ledger in /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-12-06T02:39:37.991ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562024-12-06T02:39:37.991ZINFOSledAgent (StorageManager): No ledger in /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-06T02:39:37.991ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1582024-12-06T02:39:37.991ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1592024-12-06T02:39:37.991ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1602024-12-06T02:39:37.991ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-06T02:39:37.991ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1622024-12-06T02:39:38.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1632024-12-06T02:39:38.033ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-06T02:39:38.052ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-06T02:39:38.078ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
1662024-12-06T02:39:38.078ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1672024-12-06T02:39:38.078ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
1682024-12-06T02:39:38.078ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-06T02:39:38.081ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 147.412759ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "97a3bec6-367c-424f-a330-e7ddad794c53", "content-length": "124", "date": "Fri, 06 Dec 2024 02:39:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "97a3bec6-367c-424f-a330-e7ddad794c53" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-06T02:39:38.091ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_3a67b500-470e-4683-b94c-e71013ff45af/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-06T02:39:38.117ZINFOSledAgent: successfully created encrypted zvol: name="oxi_3a67b500-470e-4683-b94c-e71013ff45af/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-06T02:39:38.117ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_3a67b500-470e-4683-b94c-e71013ff45af/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-06T02:39:38.123ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
1742024-12-06T02:39:38.123ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1752024-12-06T02:39:38.123ZINFOSledAgent (BackingFs): Ensuring dataset oxi_3a67b500-470e-4683-b94c-e71013ff45af/backing/fmd file = sled-agent/src/backing_fs.rs:138
1762024-12-06T02:39:38.224ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1772024-12-06T02:39:38.229ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782024-12-06T02:39:38.230ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 137.396125ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "34b30b0b-e305-4abd-a78c-67858a9d1747", "content-length": "124", "date": "Fri, 06 Dec 2024 02:39:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "34b30b0b-e305-4abd-a78c-67858a9d1747" } file = clients/ddm-admin-client/src/lib.rs:177
1792024-12-06T02:39:38.369ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-06T02:39:38.369ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 163.777779ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4828053c-d1dc-4f85-98a5-50807ff6e163", "content-length": "124", "date": "Fri, 06 Dec 2024 02:39:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4828053c-d1dc-4f85-98a5-50807ff6e163" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-06T02:39:38.443ZINFOSledAgent (BackingFs): Mounting oxi_3a67b500-470e-4683-b94c-e71013ff45af/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1822024-12-06T02:39:38.456ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1832024-12-06T02:39:38.456ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1842024-12-06T02:39:38.456ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1852024-12-06T02:39:38.456ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1862024-12-06T02:39:38.534ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-06T02:39:38.535ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 193.469694ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "56c9c9da-0e3d-4b00-a5fd-8f4306160241", "content-length": "124", "date": "Fri, 06 Dec 2024 02:39:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "56c9c9da-0e3d-4b00-a5fd-8f4306160241" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-06T02:39:38.729ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-06T02:39:38.729ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 184.32137ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dd287ac4-2eb2-45a7-92dc-cf46bcd39626", "content-length": "124", "date": "Fri, 06 Dec 2024 02:39:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dd287ac4-2eb2-45a7-92dc-cf46bcd39626" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-06T02:39:38.915ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-06T02:39:38.915ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 232.584347ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fae26084-99c2-4a07-bd38-427228e624b6", "content-length": "124", "date": "Fri, 06 Dec 2024 02:39:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fae26084-99c2-4a07-bd38-427228e624b6" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-06T02:39:39.149ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-06T02:39:39.149ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 307.150497ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e8673e7c-0e87-4a1b-982a-48df5bb48ea0", "content-length": "124", "date": "Fri, 06 Dec 2024 02:39:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e8673e7c-0e87-4a1b-982a-48df5bb48ea0" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-12-06T02:39:39.209ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
1952024-12-06T02:39:39.214ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:38591 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
1962024-12-06T02:39:39.214ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
1972024-12-06T02:39:39.214ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:38591 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 5455a27f-b1dd-4d8d-adde-726221dabebe sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
1982024-12-06T02:39:39.215ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 250.254364ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
1992024-12-06T02:39:39.217ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2002024-12-06T02:39:39.217ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2012024-12-06T02:39:39.217ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2022024-12-06T02:39:39.217ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-12-06T02:39:39.457ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-12-06T02:39:39.467ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 310.942298ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2052024-12-06T02:39:39.780ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.284022277s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2062024-12-06T02:39:41.066ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.803873329s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2072024-12-06T02:39:41.699ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2082024-12-06T02:39:41.699ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2092024-12-06T02:39:41.699ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2102024-12-06T02:39:41.699ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2112024-12-06T02:39:41.699ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2122024-12-06T02:39:41.699ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2132024-12-06T02:39:41.701ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2142024-12-06T02:39:41.702ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2152024-12-06T02:39:41.703ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='6379dfe0-2a46-4638-967d-13828cc17f6c'/> <propval type="astring" name="rack_id" value='fa39b2e1-03c3-48c1-8086-8e14b63b0d10'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe38:4bc8'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='fa39b2e1-03c3-48c1-8086-8e14b63b0d10'/> <propval type="astring" name="sled_id" value='5455a27f-b1dd-4d8d-adde-726221dabebe'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='5455a27f-b1dd-4d8d-adde-726221dabebe'/> <propval type="astring" name="rack_uuid" value='fa39b2e1-03c3-48c1-8086-8e14b63b0d10'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='5455a27f-b1dd-4d8d-adde-726221dabebe'/> <propval type="astring" name="rack_uuid" value='fa39b2e1-03c3-48c1-8086-8e14b63b0d10'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-12-06T02:39:41.703ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-12-06T02:39:41.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 72.987987ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-06T02:39:42.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 129.198612ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-06T02:39:42.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 191.505659ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-06T02:39:42.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 320.633025ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-06T02:39:43.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 761.105168ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-06T02:39:43.872ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.173196614s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2232024-12-06T02:39:44.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.41661351s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-06T02:39:45.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 726.709799ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-06T02:39:46.047ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.683520445s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2262024-12-06T02:39:46.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 886.988851ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-12-06T02:39:47.685ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/nexus.rs:527 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2282024-12-06T02:39:47.715ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2292024-12-06T02:39:47.715ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2302024-12-06T02:39:47.716ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312024-12-06T02:39:47.716ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322024-12-06T02:39:47.716ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2332024-12-06T02:39:47.716ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-06T02:39:47.717ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-12-06T02:39:47.717ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362024-12-06T02:39:47.717ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372024-12-06T02:39:47.717ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2382024-12-06T02:39:47.717ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58567
2392024-12-06T02:39:47.928ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2402024-12-06T02:39:47.928ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2412024-12-06T02:39:47.933ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422024-12-06T02:39:47.933ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2432024-12-06T02:39:47.933ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442024-12-06T02:39:48.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64424
2452024-12-06T02:39:48.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2462024-12-06T02:39:48.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-12-06T02:39:48.171ZINFOSledAgent (ServiceManager): No ledger in /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-zones.json file = common/src/ledger.rs:188
2482024-12-06T02:39:48.171ZINFOSledAgent (ServiceManager): No ledger in /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-zones.json file = common/src/ledger.rs:188
2492024-12-06T02:39:48.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64424 req_id = 0644cb3d-b4bd-463d-b19d-ba1ea4376389 response_code = 200 uri = /inventory
2502024-12-06T02:39:48.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55314
2512024-12-06T02:39:48.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55314 req_id = fbe968b6-0013-4a25-9ae5-deac945f582d response_code = 200 uri = /sled-role
2522024-12-06T02:39:48.233ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f5323167-50fd-42da-b24d-75f6dd3e3495 (physical_disk), pool_id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 304f8b9a-d6c2-45d5-ad41-92307e3fc1a1 (physical_disk), pool_id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 9754d325-39d5-49ca-a2a7-e6beee0f3e98 (physical_disk), pool_id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 66daab96-d07f-475f-88dd-82397d48a004 (physical_disk), pool_id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 9295cffb-66e1-4bb8-a944-2da5c0a58beb (physical_disk), pool_id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 481c2d0c-b787-4b7c-89b7-cfd25ccc94ee (physical_disk), pool_id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 3e2a0495-50e9-4a32-a792-b01b25c9085a (physical_disk), pool_id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 64704d10-3fc1-4e98-9504-2459434652ef (physical_disk), pool_id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: d021ee8d-5c7b-4bcf-870a-1015f25ad4fd (physical_disk), pool_id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2532024-12-06T02:39:48.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45516
2542024-12-06T02:39:48.233ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2552024-12-06T02:39:48.233ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f5323167-50fd-42da-b24d-75f6dd3e3495 (physical_disk), pool_id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 304f8b9a-d6c2-45d5-ad41-92307e3fc1a1 (physical_disk), pool_id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 9754d325-39d5-49ca-a2a7-e6beee0f3e98 (physical_disk), pool_id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 66daab96-d07f-475f-88dd-82397d48a004 (physical_disk), pool_id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 9295cffb-66e1-4bb8-a944-2da5c0a58beb (physical_disk), pool_id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 481c2d0c-b787-4b7c-89b7-cfd25ccc94ee (physical_disk), pool_id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 3e2a0495-50e9-4a32-a792-b01b25c9085a (physical_disk), pool_id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 64704d10-3fc1-4e98-9504-2459434652ef (physical_disk), pool_id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: d021ee8d-5c7b-4bcf-870a-1015f25ad4fd (physical_disk), pool_id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2562024-12-06T02:39:48.233ZINFOSledAgent (StorageManager): No ledger in /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572024-12-06T02:39:48.233ZINFOSledAgent (StorageManager): No ledger in /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582024-12-06T02:39:48.233ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2592024-12-06T02:39:48.233ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2602024-12-06T02:39:48.233ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2612024-12-06T02:39:48.233ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2622024-12-06T02:39:48.233ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2632024-12-06T02:39:48.393ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2642024-12-06T02:39:48.393ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool)
2652024-12-06T02:39:48.864ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2662024-12-06T02:39:49.325ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15866858060571901303 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2672024-12-06T02:39:49.325ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4428700220340669153 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2682024-12-06T02:39:49.542ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2692024-12-06T02:39:49.555ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }
2702024-12-06T02:39:49.563ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2712024-12-06T02:39:49.563ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2722024-12-06T02:39:49.563ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2732024-12-06T02:39:49.563ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2742024-12-06T02:39:49.563ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-12-06T02:39:49.563ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762024-12-06T02:39:49.563ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2772024-12-06T02:39:49.606ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2782024-12-06T02:39:49.614ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone file = sled-storage/src/dataset.rs:303
2792024-12-06T02:39:49.814ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2770546e-59fa-4ec3-8490-b551f4075d06 file = sled-storage/src/dataset.rs:389
2802024-12-06T02:39:49.822ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2812024-12-06T02:39:49.822ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2822024-12-06T02:39:49.822ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2832024-12-06T02:39:49.822ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842024-12-06T02:39:49.822ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2852024-12-06T02:39:49.832ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2862024-12-06T02:39:49.832ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool)
2872024-12-06T02:39:49.939ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }
2882024-12-06T02:39:49.947ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2892024-12-06T02:39:49.947ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2902024-12-06T02:39:49.947ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2912024-12-06T02:39:49.947ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2922024-12-06T02:39:49.947ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-06T02:39:49.947ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-12-06T02:39:49.947ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2952024-12-06T02:39:49.951ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
2962024-12-06T02:39:49.986ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2972024-12-06T02:39:49.994ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone file = sled-storage/src/dataset.rs:303
2982024-12-06T02:39:50.201ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 file = sled-storage/src/dataset.rs:389
2992024-12-06T02:39:50.209ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3002024-12-06T02:39:50.209ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3012024-12-06T02:39:50.209ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3022024-12-06T02:39:50.209ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3032024-12-06T02:39:50.209ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3042024-12-06T02:39:50.220ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3052024-12-06T02:39:50.220ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool)
3062024-12-06T02:39:50.328ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }
3072024-12-06T02:39:50.334ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3082024-12-06T02:39:50.334ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3092024-12-06T02:39:50.334ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3102024-12-06T02:39:50.334ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3112024-12-06T02:39:50.335ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-12-06T02:39:50.335ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132024-12-06T02:39:50.335ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3142024-12-06T02:39:50.379ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3152024-12-06T02:39:50.387ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone file = sled-storage/src/dataset.rs:303
3162024-12-06T02:39:50.595ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2 file = sled-storage/src/dataset.rs:389
3172024-12-06T02:39:50.603ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3182024-12-06T02:39:50.603ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3192024-12-06T02:39:50.603ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3202024-12-06T02:39:50.603ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3212024-12-06T02:39:50.603ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222024-12-06T02:39:50.612ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3232024-12-06T02:39:50.612ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool)
3242024-12-06T02:39:50.728ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }
3252024-12-06T02:39:50.736ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3262024-12-06T02:39:50.736ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3272024-12-06T02:39:50.736ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3282024-12-06T02:39:50.736ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3292024-12-06T02:39:50.736ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-12-06T02:39:50.736ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-12-06T02:39:50.736ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3322024-12-06T02:39:50.777ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332024-12-06T02:39:50.785ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/zone file = sled-storage/src/dataset.rs:303
3342024-12-06T02:39:50.953ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
3352024-12-06T02:39:50.986ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726 file = sled-storage/src/dataset.rs:389
3362024-12-06T02:39:50.994ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3372024-12-06T02:39:50.994ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3382024-12-06T02:39:50.994ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3392024-12-06T02:39:50.994ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402024-12-06T02:39:50.994ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3412024-12-06T02:39:51.004ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3422024-12-06T02:39:51.004ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool)
3432024-12-06T02:39:51.112ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }
3442024-12-06T02:39:51.119ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3452024-12-06T02:39:51.119ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3462024-12-06T02:39:51.119ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3472024-12-06T02:39:51.119ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3482024-12-06T02:39:51.119ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-12-06T02:39:51.119ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502024-12-06T02:39:51.119ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3512024-12-06T02:39:51.160ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522024-12-06T02:39:51.168ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone file = sled-storage/src/dataset.rs:303
3532024-12-06T02:39:51.372ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2e1578fd-7835-4cef-bc2c-ab571a943504 file = sled-storage/src/dataset.rs:389
3542024-12-06T02:39:51.381ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3552024-12-06T02:39:51.381ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3562024-12-06T02:39:51.381ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3572024-12-06T02:39:51.381ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3582024-12-06T02:39:51.381ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3592024-12-06T02:39:51.391ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3602024-12-06T02:39:51.391ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool)
3612024-12-06T02:39:51.502ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }
3622024-12-06T02:39:51.511ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3632024-12-06T02:39:51.511ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3642024-12-06T02:39:51.512ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3652024-12-06T02:39:51.512ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3662024-12-06T02:39:51.512ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-12-06T02:39:51.512ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682024-12-06T02:39:51.512ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3692024-12-06T02:39:51.556ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702024-12-06T02:39:51.564ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb/crypt/zone file = sled-storage/src/dataset.rs:303
3712024-12-06T02:39:51.770ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb file = sled-storage/src/dataset.rs:389
3722024-12-06T02:39:51.777ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3732024-12-06T02:39:51.777ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3742024-12-06T02:39:51.777ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3752024-12-06T02:39:51.777ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3762024-12-06T02:39:51.777ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3772024-12-06T02:39:51.788ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3782024-12-06T02:39:51.788ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool)
3792024-12-06T02:39:51.903ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }
3802024-12-06T02:39:51.911ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3812024-12-06T02:39:51.911ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3822024-12-06T02:39:51.911ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3832024-12-06T02:39:51.911ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3842024-12-06T02:39:51.911ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-12-06T02:39:51.911ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-12-06T02:39:51.911ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3872024-12-06T02:39:51.954ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3882024-12-06T02:39:51.958ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
3892024-12-06T02:39:51.962ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3215e18d-10da-4248-a0ac-1e11521027d3/crypt/zone file = sled-storage/src/dataset.rs:303
3902024-12-06T02:39:52.176ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3215e18d-10da-4248-a0ac-1e11521027d3 file = sled-storage/src/dataset.rs:389
3912024-12-06T02:39:52.184ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3922024-12-06T02:39:52.184ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3932024-12-06T02:39:52.184ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3942024-12-06T02:39:52.184ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952024-12-06T02:39:52.184ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962024-12-06T02:39:52.194ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3972024-12-06T02:39:52.194ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool)
3982024-12-06T02:39:52.306ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }
3992024-12-06T02:39:52.314ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4002024-12-06T02:39:52.314ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4012024-12-06T02:39:52.314ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4022024-12-06T02:39:52.314ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4032024-12-06T02:39:52.314ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-12-06T02:39:52.314ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-12-06T02:39:52.315ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4062024-12-06T02:39:52.355ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-12-06T02:39:52.363ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea/crypt/zone file = sled-storage/src/dataset.rs:303
4082024-12-06T02:39:52.568ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea file = sled-storage/src/dataset.rs:389
4092024-12-06T02:39:52.576ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4102024-12-06T02:39:52.576ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4112024-12-06T02:39:52.576ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4122024-12-06T02:39:52.576ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4132024-12-06T02:39:52.576ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142024-12-06T02:39:52.585ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4152024-12-06T02:39:52.585ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool)
4162024-12-06T02:39:52.696ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }
4172024-12-06T02:39:52.704ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4182024-12-06T02:39:52.704ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4192024-12-06T02:39:52.704ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4202024-12-06T02:39:52.704ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4212024-12-06T02:39:52.704ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-12-06T02:39:52.704ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-12-06T02:39:52.704ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4242024-12-06T02:39:52.744ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-12-06T02:39:52.752ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867/crypt/zone file = sled-storage/src/dataset.rs:303
4262024-12-06T02:39:52.959ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867 file = sled-storage/src/dataset.rs:389
4272024-12-06T02:39:52.963ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4282024-12-06T02:39:52.967ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4292024-12-06T02:39:52.967ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4302024-12-06T02:39:52.967ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312024-12-06T02:39:52.967ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a67b500-470e-4683-b94c-e71013ff45af (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4322024-12-06T02:39:52.968ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4332024-12-06T02:39:52.968ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4342024-12-06T02:39:52.968ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4352024-12-06T02:39:52.968ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4362024-12-06T02:39:52.968ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4372024-12-06T02:39:52.968ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4382024-12-06T02:39:52.968ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4392024-12-06T02:39:52.968ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4402024-12-06T02:39:52.968ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4412024-12-06T02:39:52.968ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4422024-12-06T02:39:52.968ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4432024-12-06T02:39:52.968ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4442024-12-06T02:39:52.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4735043 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45516 req_id = 34617aeb-ffd6-442f-be5c-80fb617bf5ff response_code = 200 uri = /omicron-physical-disks
4452024-12-06T02:39:53.000ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0086c5dd-73ec-40de-8935-91fc8d63b35e (dataset): DatasetConfig { id: 0086c5dd-73ec-40de-8935-91fc8d63b35e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 01ce01fb-d67d-462e-9d25-cb8bb9b8c33e (dataset): DatasetConfig { id: 01ce01fb-d67d-462e-9d25-cb8bb9b8c33e (dataset), name: DatasetName { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 042d4b11-ed18-47c0-a889-6d1756566060 (dataset): DatasetConfig { id: 042d4b11-ed18-47c0-a889-6d1756566060 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04a04893-5b62-4aa6-9d54-5243f138778d (dataset): DatasetConfig { id: 04a04893-5b62-4aa6-9d54-5243f138778d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 07f023a7-5f7c-4e20-a9f3-c4f7c24cb3a3 (dataset): DatasetConfig { id: 07f023a7-5f7c-4e20-a9f3-c4f7c24cb3a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09ed866d-c7e6-4d8d-b290-322e47a63c91 (dataset): DatasetConfig { id: 09ed866d-c7e6-4d8d-b290-322e47a63c91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dc2a4be-2874-4699-ab32-c2c172c6dbf9 (dataset): DatasetConfig { id: 0dc2a4be-2874-4699-ab32-c2c172c6dbf9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ff94dde-0e24-454c-acd2-99059452a1b0 (dataset): DatasetConfig { id: 0ff94dde-0e24-454c-acd2-99059452a1b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 124d059b-02ed-449e-9d17-6cc161bff3d6 (dataset): DatasetConfig { id: 124d059b-02ed-449e-9d17-6cc161bff3d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 19880e03-988f-43bc-a17c-4aaac581a9cb (dataset): DatasetConfig { id: 19880e03-988f-43bc-a17c-4aaac581a9cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a49932d-5a7d-4c49-9b24-7afea7224a51 (dataset): DatasetConfig { id: 1a49932d-5a7d-4c49-9b24-7afea7224a51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c357e27-dfa2-496e-9fcd-41ba589b3c21 (dataset): DatasetConfig { id: 1c357e27-dfa2-496e-9fcd-41ba589b3c21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f7e9e7b-7cf3-40fe-bda4-a324b046c180 (dataset): DatasetConfig { id: 1f7e9e7b-7cf3-40fe-bda4-a324b046c180 (dataset), name: DatasetName { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22e22773-2cc5-4998-9795-197fdb3196be (dataset): DatasetConfig { id: 22e22773-2cc5-4998-9795-197fdb3196be (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 285be587-a00a-40cd-93ec-e9585a616552 (dataset): DatasetConfig { id: 285be587-a00a-40cd-93ec-e9585a616552 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2af9e2db-7cc6-4985-8a31-d69c8f62193a (dataset): DatasetConfig { id: 2af9e2db-7cc6-4985-8a31-d69c8f62193a (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e82ad44-a964-4fb6-b8db-67ce7bbe24f6 (dataset): DatasetConfig { id: 2e82ad44-a964-4fb6-b8db-67ce7bbe24f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 31487567-1b18-4fff-af84-c044b8aaa86f (dataset): DatasetConfig { id: 31487567-1b18-4fff-af84-c044b8aaa86f (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36330c11-08d2-4ba8-aad0-8fe1d70d218b (dataset): DatasetConfig { id: 36330c11-08d2-4ba8-aad0-8fe1d70d218b (dataset), name: DatasetName { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 371262a3-dafc-4063-80db-41acad78b205 (dataset): DatasetConfig { id: 371262a3-dafc-4063-80db-41acad78b205 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a875b19-1580-4d5c-881c-c3e84c3bab3a (dataset): DatasetConfig { id: 3a875b19-1580-4d5c-881c-c3e84c3bab3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b80d154-1e90-482e-b1c4-ba35d6feab9f (dataset): DatasetConfig { id: 3b80d154-1e90-482e-b1c4-ba35d6feab9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f4ff889-220e-4591-809a-0b90f852e03b (dataset): DatasetConfig { id: 3f4ff889-220e-4591-809a-0b90f852e03b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ff231d3-7235-43b6-a0a1-371706bb7a05 (dataset): DatasetConfig { id: 3ff231d3-7235-43b6-a0a1-371706bb7a05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4538ff68-151d-4ca0-bff7-24dfc018621a (dataset): DatasetConfig { id: 4538ff68-151d-4ca0-bff7-24dfc018621a (dataset), name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4646c385-1947-429f-8830-b203960fe43e (dataset): DatasetConfig { id: 4646c385-1947-429f-8830-b203960fe43e (dataset), name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4845d0b3-66bd-45fa-bbcf-0c15ef33d3c5 (dataset): DatasetConfig { id: 4845d0b3-66bd-45fa-bbcf-0c15ef33d3c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ade8c27-f3e2-408d-85f2-4879fdf3ec7b (dataset): DatasetConfig { id: 4ade8c27-f3e2-408d-85f2-4879fdf3ec7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5655d573-6102-4465-93de-887abc589eef (dataset): DatasetConfig { id: 5655d573-6102-4465-93de-887abc589eef (dataset), name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 590af9bc-ede8-4a23-a463-068efa7ab22a (dataset): DatasetConfig { id: 590af9bc-ede8-4a23-a463-068efa7ab22a (dataset), name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f86a57f-1a86-4eb6-b6ab-12397549bc6f (dataset): DatasetConfig { id: 5f86a57f-1a86-4eb6-b6ab-12397549bc6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65fc826a-9012-4460-922f-2519f4bbc2db (dataset): DatasetConfig { id: 65fc826a-9012-4460-922f-2519f4bbc2db (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6861d462-638b-4e2b-a0c6-3c632ed659fd (dataset): DatasetConfig { id: 6861d462-638b-4e2b-a0c6-3c632ed659fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ad0f047-d28a-4f76-93ce-27834330617c (dataset): DatasetConfig { id: 6ad0f047-d28a-4f76-93ce-27834330617c (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d7b7707-c701-4d5c-8ccc-080cec74648b (dataset): DatasetConfig { id: 6d7b7707-c701-4d5c-8ccc-080cec74648b (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e79272c-3f77-4bc9-8a8b-6037fdf57641 (dataset): DatasetConfig { id: 6e79272c-3f77-4bc9-8a8b-6037fdf57641 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7227bc9b-2e65-4839-9616-4c681e8a341e (dataset): DatasetConfig { id: 7227bc9b-2e65-4839-9616-4c681e8a341e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74223e6f-0a62-41f7-af0e-89f3ab4d1485 (dataset): DatasetConfig { id: 74223e6f-0a62-41f7-af0e-89f3ab4d1485 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 761ea087-3760-4da9-815b-b69321938f1a (dataset): DatasetConfig { id: 761ea087-3760-4da9-815b-b69321938f1a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f0d0e25-3ce2-4ae9-977e-82b592ad785c (dataset): DatasetConfig { id: 7f0d0e25-3ce2-4ae9-977e-82b592ad785c (dataset), name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f91407b-ad8f-469d-aa67-ceaeedfbbfdd (dataset): DatasetConfig { id: 7f91407b-ad8f-469d-aa67-ceaeedfbbfdd (dataset), name: DatasetName { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85f5c89b-4f16-481d-90ab-32695e597f7d (dataset): DatasetConfig { id: 85f5c89b-4f16-481d-90ab-32695e597f7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86c75712-af0f-45e3-a898-e464d0e43535 (dataset): DatasetConfig { id: 86c75712-af0f-45e3-a898-e464d0e43535 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c69e331-1e47-4b92-baee-a5835b980c91 (dataset): DatasetConfig { id: 8c69e331-1e47-4b92-baee-a5835b980c91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8da7eccc-671e-44f8-912b-24beb3d17a3a (dataset): DatasetConfig { id: 8da7eccc-671e-44f8-912b-24beb3d17a3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9350a3d9-6ebe-47b0-98a8-d2aadc1ed43d (dataset): DatasetConfig { id: 9350a3d9-6ebe-47b0-98a8-d2aadc1ed43d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98d4f94b-e4bf-4f7e-ab38-aaf579e3c3ea (dataset): DatasetConfig { id: 98d4f94b-e4bf-4f7e-ab38-aaf579e3c3ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98fa4aab-8ea4-48d5-a29a-db0ced8fd147 (dataset): DatasetConfig { id: 98fa4aab-8ea4-48d5-a29a-db0ced8fd147 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f647d6b-acda-4d1c-8f2c-7f0f9237e30d (dataset): DatasetConfig { id: 9f647d6b-acda-4d1c-8f2c-7f0f9237e30d (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1d1d981-217d-4f27-96a3-a4b867cd56ee (dataset): DatasetConfig { id: a1d1d981-217d-4f27-96a3-a4b867cd56ee (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a262e9c5-38ab-4b6e-a9ca-14271291df7f (dataset): DatasetConfig { id: a262e9c5-38ab-4b6e-a9ca-14271291df7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a27cccbf-b72e-43aa-9a81-a09fb062cee5 (dataset): DatasetConfig { id: a27cccbf-b72e-43aa-9a81-a09fb062cee5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a42add62-265a-4d70-a755-2bdf5a3d622b (dataset): DatasetConfig { id: a42add62-265a-4d70-a755-2bdf5a3d622b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ab7a8506-3c86-4c91-8f8a-ed4410b7bb8e (dataset): DatasetConfig { id: ab7a8506-3c86-4c91-8f8a-ed4410b7bb8e (dataset), name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ad16d128-b6d3-490b-9861-36cb9f9d34ac (dataset): DatasetConfig { id: ad16d128-b6d3-490b-9861-36cb9f9d34ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, afb83b50-f615-49cc-965a-a2bd09aaad44 (dataset): DatasetConfig { id: afb83b50-f615-49cc-965a-a2bd09aaad44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b078d24f-9697-415f-8a58-31801fb55ea7 (dataset): DatasetConfig { id: b078d24f-9697-415f-8a58-31801fb55ea7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8121ef4-8f03-4bc8-bb0e-0b303a3c88e9 (dataset): DatasetConfig { id: b8121ef4-8f03-4bc8-bb0e-0b303a3c88e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be85b432-d7a0-49c0-9375-2a5c7722b9ce (dataset): DatasetConfig { id: be85b432-d7a0-49c0-9375-2a5c7722b9ce (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc42ef0a-0ac4-4dd5-bfe0-8da8cde92795 (dataset): DatasetConfig { id: cc42ef0a-0ac4-4dd5-bfe0-8da8cde92795 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d59824e5-c12f-4e3d-a314-9e5607b98308 (dataset): DatasetConfig { id: d59824e5-c12f-4e3d-a314-9e5607b98308 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9b50fd2-30f6-4d8e-80a3-ec491e8a36f7 (dataset): DatasetConfig { id: d9b50fd2-30f6-4d8e-80a3-ec491e8a36f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e2321bdf-fab1-4c98-a938-db72bf0470c3 (dataset): DatasetConfig { id: e2321bdf-fab1-4c98-a938-db72bf0470c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e779cab6-ea48-4ca0-8312-462d7871dd06 (dataset): DatasetConfig { id: e779cab6-ea48-4ca0-8312-462d7871dd06 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed2cad7b-dbc6-4e6f-9019-e9aa2560ec3c (dataset): DatasetConfig { id: ed2cad7b-dbc6-4e6f-9019-e9aa2560ec3c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2457919-8fe0-465d-8c54-c600bdfc6878 (dataset): DatasetConfig { id: f2457919-8fe0-465d-8c54-c600bdfc6878 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4462024-12-06T02:39:53.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38209
4472024-12-06T02:39:53.000ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4482024-12-06T02:39:53.001ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0086c5dd-73ec-40de-8935-91fc8d63b35e (dataset): DatasetConfig { id: 0086c5dd-73ec-40de-8935-91fc8d63b35e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 01ce01fb-d67d-462e-9d25-cb8bb9b8c33e (dataset): DatasetConfig { id: 01ce01fb-d67d-462e-9d25-cb8bb9b8c33e (dataset), name: DatasetName { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 042d4b11-ed18-47c0-a889-6d1756566060 (dataset): DatasetConfig { id: 042d4b11-ed18-47c0-a889-6d1756566060 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04a04893-5b62-4aa6-9d54-5243f138778d (dataset): DatasetConfig { id: 04a04893-5b62-4aa6-9d54-5243f138778d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 07f023a7-5f7c-4e20-a9f3-c4f7c24cb3a3 (dataset): DatasetConfig { id: 07f023a7-5f7c-4e20-a9f3-c4f7c24cb3a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09ed866d-c7e6-4d8d-b290-322e47a63c91 (dataset): DatasetConfig { id: 09ed866d-c7e6-4d8d-b290-322e47a63c91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dc2a4be-2874-4699-ab32-c2c172c6dbf9 (dataset): DatasetConfig { id: 0dc2a4be-2874-4699-ab32-c2c172c6dbf9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ff94dde-0e24-454c-acd2-99059452a1b0 (dataset): DatasetConfig { id: 0ff94dde-0e24-454c-acd2-99059452a1b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 124d059b-02ed-449e-9d17-6cc161bff3d6 (dataset): DatasetConfig { id: 124d059b-02ed-449e-9d17-6cc161bff3d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 19880e03-988f-43bc-a17c-4aaac581a9cb (dataset): DatasetConfig { id: 19880e03-988f-43bc-a17c-4aaac581a9cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a49932d-5a7d-4c49-9b24-7afea7224a51 (dataset): DatasetConfig { id: 1a49932d-5a7d-4c49-9b24-7afea7224a51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c357e27-dfa2-496e-9fcd-41ba589b3c21 (dataset): DatasetConfig { id: 1c357e27-dfa2-496e-9fcd-41ba589b3c21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f7e9e7b-7cf3-40fe-bda4-a324b046c180 (dataset): DatasetConfig { id: 1f7e9e7b-7cf3-40fe-bda4-a324b046c180 (dataset), name: DatasetName { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22e22773-2cc5-4998-9795-197fdb3196be (dataset): DatasetConfig { id: 22e22773-2cc5-4998-9795-197fdb3196be (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 285be587-a00a-40cd-93ec-e9585a616552 (dataset): DatasetConfig { id: 285be587-a00a-40cd-93ec-e9585a616552 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2af9e2db-7cc6-4985-8a31-d69c8f62193a (dataset): DatasetConfig { id: 2af9e2db-7cc6-4985-8a31-d69c8f62193a (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e82ad44-a964-4fb6-b8db-67ce7bbe24f6 (dataset): DatasetConfig { id: 2e82ad44-a964-4fb6-b8db-67ce7bbe24f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 31487567-1b18-4fff-af84-c044b8aaa86f (dataset): DatasetConfig { id: 31487567-1b18-4fff-af84-c044b8aaa86f (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36330c11-08d2-4ba8-aad0-8fe1d70d218b (dataset): DatasetConfig { id: 36330c11-08d2-4ba8-aad0-8fe1d70d218b (dataset), name: DatasetName { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 371262a3-dafc-4063-80db-41acad78b205 (dataset): DatasetConfig { id: 371262a3-dafc-4063-80db-41acad78b205 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a875b19-1580-4d5c-881c-c3e84c3bab3a (dataset): DatasetConfig { id: 3a875b19-1580-4d5c-881c-c3e84c3bab3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b80d154-1e90-482e-b1c4-ba35d6feab9f (dataset): DatasetConfig { id: 3b80d154-1e90-482e-b1c4-ba35d6feab9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f4ff889-220e-4591-809a-0b90f852e03b (dataset): DatasetConfig { id: 3f4ff889-220e-4591-809a-0b90f852e03b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ff231d3-7235-43b6-a0a1-371706bb7a05 (dataset): DatasetConfig { id: 3ff231d3-7235-43b6-a0a1-371706bb7a05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4538ff68-151d-4ca0-bff7-24dfc018621a (dataset): DatasetConfig { id: 4538ff68-151d-4ca0-bff7-24dfc018621a (dataset), name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4646c385-1947-429f-8830-b203960fe43e (dataset): DatasetConfig { id: 4646c385-1947-429f-8830-b203960fe43e (dataset), name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4845d0b3-66bd-45fa-bbcf-0c15ef33d3c5 (dataset): DatasetConfig { id: 4845d0b3-66bd-45fa-bbcf-0c15ef33d3c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ade8c27-f3e2-408d-85f2-4879fdf3ec7b (dataset): DatasetConfig { id: 4ade8c27-f3e2-408d-85f2-4879fdf3ec7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5655d573-6102-4465-93de-887abc589eef (dataset): DatasetConfig { id: 5655d573-6102-4465-93de-887abc589eef (dataset), name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 590af9bc-ede8-4a23-a463-068efa7ab22a (dataset): DatasetConfig { id: 590af9bc-ede8-4a23-a463-068efa7ab22a (dataset), name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f86a57f-1a86-4eb6-b6ab-12397549bc6f (dataset): DatasetConfig { id: 5f86a57f-1a86-4eb6-b6ab-12397549bc6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65fc826a-9012-4460-922f-2519f4bbc2db (dataset): DatasetConfig { id: 65fc826a-9012-4460-922f-2519f4bbc2db (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6861d462-638b-4e2b-a0c6-3c632ed659fd (dataset): DatasetConfig { id: 6861d462-638b-4e2b-a0c6-3c632ed659fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ad0f047-d28a-4f76-93ce-27834330617c (dataset): DatasetConfig { id: 6ad0f047-d28a-4f76-93ce-27834330617c (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d7b7707-c701-4d5c-8ccc-080cec74648b (dataset): DatasetConfig { id: 6d7b7707-c701-4d5c-8ccc-080cec74648b (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e79272c-3f77-4bc9-8a8b-6037fdf57641 (dataset): DatasetConfig { id: 6e79272c-3f77-4bc9-8a8b-6037fdf57641 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7227bc9b-2e65-4839-9616-4c681e8a341e (dataset): DatasetConfig { id: 7227bc9b-2e65-4839-9616-4c681e8a341e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74223e6f-0a62-41f7-af0e-89f3ab4d1485 (dataset): DatasetConfig { id: 74223e6f-0a62-41f7-af0e-89f3ab4d1485 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 761ea087-3760-4da9-815b-b69321938f1a (dataset): DatasetConfig { id: 761ea087-3760-4da9-815b-b69321938f1a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f0d0e25-3ce2-4ae9-977e-82b592ad785c (dataset): DatasetConfig { id: 7f0d0e25-3ce2-4ae9-977e-82b592ad785c (dataset), name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f91407b-ad8f-469d-aa67-ceaeedfbbfdd (dataset): DatasetConfig { id: 7f91407b-ad8f-469d-aa67-ceaeedfbbfdd (dataset), name: DatasetName { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85f5c89b-4f16-481d-90ab-32695e597f7d (dataset): DatasetConfig { id: 85f5c89b-4f16-481d-90ab-32695e597f7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86c75712-af0f-45e3-a898-e464d0e43535 (dataset): DatasetConfig { id: 86c75712-af0f-45e3-a898-e464d0e43535 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c69e331-1e47-4b92-baee-a5835b980c91 (dataset): DatasetConfig { id: 8c69e331-1e47-4b92-baee-a5835b980c91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8da7eccc-671e-44f8-912b-24beb3d17a3a (dataset): DatasetConfig { id: 8da7eccc-671e-44f8-912b-24beb3d17a3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9350a3d9-6ebe-47b0-98a8-d2aadc1ed43d (dataset): DatasetConfig { id: 9350a3d9-6ebe-47b0-98a8-d2aadc1ed43d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98d4f94b-e4bf-4f7e-ab38-aaf579e3c3ea (dataset): DatasetConfig { id: 98d4f94b-e4bf-4f7e-ab38-aaf579e3c3ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98fa4aab-8ea4-48d5-a29a-db0ced8fd147 (dataset): DatasetConfig { id: 98fa4aab-8ea4-48d5-a29a-db0ced8fd147 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f647d6b-acda-4d1c-8f2c-7f0f9237e30d (dataset): DatasetConfig { id: 9f647d6b-acda-4d1c-8f2c-7f0f9237e30d (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1d1d981-217d-4f27-96a3-a4b867cd56ee (dataset): DatasetConfig { id: a1d1d981-217d-4f27-96a3-a4b867cd56ee (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a262e9c5-38ab-4b6e-a9ca-14271291df7f (dataset): DatasetConfig { id: a262e9c5-38ab-4b6e-a9ca-14271291df7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a27cccbf-b72e-43aa-9a81-a09fb062cee5 (dataset): DatasetConfig { id: a27cccbf-b72e-43aa-9a81-a09fb062cee5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a42add62-265a-4d70-a755-2bdf5a3d622b (dataset): DatasetConfig { id: a42add62-265a-4d70-a755-2bdf5a3d622b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ab7a8506-3c86-4c91-8f8a-ed4410b7bb8e (dataset): DatasetConfig { id: ab7a8506-3c86-4c91-8f8a-ed4410b7bb8e (dataset), name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ad16d128-b6d3-490b-9861-36cb9f9d34ac (dataset): DatasetConfig { id: ad16d128-b6d3-490b-9861-36cb9f9d34ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, afb83b50-f615-49cc-965a-a2bd09aaad44 (dataset): DatasetConfig { id: afb83b50-f615-49cc-965a-a2bd09aaad44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b078d24f-9697-415f-8a58-31801fb55ea7 (dataset): DatasetConfig { id: b078d24f-9697-415f-8a58-31801fb55ea7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8121ef4-8f03-4bc8-bb0e-0b303a3c88e9 (dataset): DatasetConfig { id: b8121ef4-8f03-4bc8-bb0e-0b303a3c88e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be85b432-d7a0-49c0-9375-2a5c7722b9ce (dataset): DatasetConfig { id: be85b432-d7a0-49c0-9375-2a5c7722b9ce (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc42ef0a-0ac4-4dd5-bfe0-8da8cde92795 (dataset): DatasetConfig { id: cc42ef0a-0ac4-4dd5-bfe0-8da8cde92795 (dataset), name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d59824e5-c12f-4e3d-a314-9e5607b98308 (dataset): DatasetConfig { id: d59824e5-c12f-4e3d-a314-9e5607b98308 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9b50fd2-30f6-4d8e-80a3-ec491e8a36f7 (dataset): DatasetConfig { id: d9b50fd2-30f6-4d8e-80a3-ec491e8a36f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e2321bdf-fab1-4c98-a938-db72bf0470c3 (dataset): DatasetConfig { id: e2321bdf-fab1-4c98-a938-db72bf0470c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e779cab6-ea48-4ca0-8312-462d7871dd06 (dataset): DatasetConfig { id: e779cab6-ea48-4ca0-8312-462d7871dd06 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed2cad7b-dbc6-4e6f-9019-e9aa2560ec3c (dataset): DatasetConfig { id: ed2cad7b-dbc6-4e6f-9019-e9aa2560ec3c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2457919-8fe0-465d-8c54-c600bdfc6878 (dataset): DatasetConfig { id: f2457919-8fe0-465d-8c54-c600bdfc6878 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4492024-12-06T02:39:53.001ZINFOSledAgent (StorageManager): No ledger in /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4502024-12-06T02:39:53.001ZINFOSledAgent (StorageManager): No ledger in /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4512024-12-06T02:39:53.001ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4522024-12-06T02:39:53.001ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4532024-12-06T02:39:53.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3215e18d-10da-4248-a0ac-1e11521027d3/crypt/debug"), full_name: "oxp_3215e18d-10da-4248-a0ac-1e11521027d3/crypt/debug" } file = sled-storage/src/manager.rs:1331
4542024-12-06T02:39:53.081ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4552024-12-06T02:39:53.081ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/34634e59-48bd-47f5-8bfe-ff4934b5a3bb/crypt/debug"), full_name: "oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb/crypt/debug" } file = sled-storage/src/manager.rs:1331
4562024-12-06T02:39:53.159ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4572024-12-06T02:39:53.159ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone/oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8"), full_name: "oxp_2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone/oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8" } file = sled-storage/src/manager.rs:1331
4582024-12-06T02:39:53.273ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4592024-12-06T02:39:53.273ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
4602024-12-06T02:39:53.377ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4612024-12-06T02:39:53.377ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone/oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone/oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e" } file = sled-storage/src/manager.rs:1331
4622024-12-06T02:39:53.491ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4632024-12-06T02:39:53.491ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone/oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19"), full_name: "oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone/oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19" } file = sled-storage/src/manager.rs:1331
4642024-12-06T02:39:53.607ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-12-06T02:39:53.607ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4662024-12-06T02:39:53.714ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-12-06T02:39:53.714ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4682024-12-06T02:39:53.820ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-12-06T02:39:53.821ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/debug"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/debug" } file = sled-storage/src/manager.rs:1331
4702024-12-06T02:39:53.901ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-12-06T02:39:53.901ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83a6f053-9a9e-49d7-aa01-2ac3088ef867/crypt/zone/oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25"), full_name: "oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867/crypt/zone/oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25" } file = sled-storage/src/manager.rs:1331
4722024-12-06T02:39:53.965ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4732024-12-06T02:39:54.018ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-12-06T02:39:54.018ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d" } file = sled-storage/src/manager.rs:1331
4752024-12-06T02:39:54.132ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-12-06T02:39:54.132ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone"), full_name: "oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone" } file = sled-storage/src/manager.rs:1331
4772024-12-06T02:39:54.213ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-12-06T02:39:54.213ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/34634e59-48bd-47f5-8bfe-ff4934b5a3bb/crypt/zone/oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81"), full_name: "oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb/crypt/zone/oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81" } file = sled-storage/src/manager.rs:1331
4792024-12-06T02:39:54.328ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-12-06T02:39:54.328ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964" } file = sled-storage/src/manager.rs:1331
4812024-12-06T02:39:54.443ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-12-06T02:39:54.443ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83a6f053-9a9e-49d7-aa01-2ac3088ef867/crypt/zone"), full_name: "oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867/crypt/zone" } file = sled-storage/src/manager.rs:1331
4832024-12-06T02:39:54.522ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-12-06T02:39:54.522ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4852024-12-06T02:39:54.630ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-12-06T02:39:54.630ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3215e18d-10da-4248-a0ac-1e11521027d3/crypt/zone"), full_name: "oxp_3215e18d-10da-4248-a0ac-1e11521027d3/crypt/zone" } file = sled-storage/src/manager.rs:1331
4872024-12-06T02:39:54.709ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-12-06T02:39:54.709ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone" } file = sled-storage/src/manager.rs:1331
4892024-12-06T02:39:54.791ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902024-12-06T02:39:54.791ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/34634e59-48bd-47f5-8bfe-ff4934b5a3bb/crypt/zone"), full_name: "oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb/crypt/zone" } file = sled-storage/src/manager.rs:1331
4912024-12-06T02:39:54.873ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922024-12-06T02:39:54.873ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83a6f053-9a9e-49d7-aa01-2ac3088ef867/crypt/zone/oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227"), full_name: "oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867/crypt/zone/oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227" } file = sled-storage/src/manager.rs:1331
4932024-12-06T02:39:54.970ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
4942024-12-06T02:39:54.992ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-12-06T02:39:54.992ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4962024-12-06T02:39:55.101ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-12-06T02:39:55.101ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone/oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0"), full_name: "oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone/oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0" } file = sled-storage/src/manager.rs:1331
4982024-12-06T02:39:55.216ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-12-06T02:39:55.216ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone"), full_name: "oxp_2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone" } file = sled-storage/src/manager.rs:1331
5002024-12-06T02:39:55.295ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-12-06T02:39:55.295ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3215e18d-10da-4248-a0ac-1e11521027d3/crucible" } file = sled-storage/src/manager.rs:1331
5022024-12-06T02:39:55.401ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-12-06T02:39:55.401ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/49a626ef-96f9-42b6-8143-bf2801f1f5ea/crypt/debug"), full_name: "oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea/crypt/debug" } file = sled-storage/src/manager.rs:1331
5042024-12-06T02:39:55.484ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-12-06T02:39:55.484ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867/crucible" } file = sled-storage/src/manager.rs:1331
5062024-12-06T02:39:55.595ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-12-06T02:39:55.595ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526" } file = sled-storage/src/manager.rs:1331
5082024-12-06T02:39:55.714ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-12-06T02:39:55.714ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crucible" } file = sled-storage/src/manager.rs:1331
5102024-12-06T02:39:55.731ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.29535994s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
5112024-12-06T02:39:55.821ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5122024-12-06T02:39:55.821ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea/crucible" } file = sled-storage/src/manager.rs:1331
5132024-12-06T02:39:55.930ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5142024-12-06T02:39:55.930ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/49a626ef-96f9-42b6-8143-bf2801f1f5ea/crypt/zone/oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4"), full_name: "oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea/crypt/zone/oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4" } file = sled-storage/src/manager.rs:1331
5152024-12-06T02:39:55.972ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
5162024-12-06T02:39:56.066ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172024-12-06T02:39:56.066ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone/oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone/oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2" } file = sled-storage/src/manager.rs:1331
5182024-12-06T02:39:56.200ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5192024-12-06T02:39:56.200ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1" } file = sled-storage/src/manager.rs:1331
5202024-12-06T02:39:56.320ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5212024-12-06T02:39:56.320ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone/oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd"), full_name: "oxp_2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone/oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd" } file = sled-storage/src/manager.rs:1331
5222024-12-06T02:39:56.425ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232024-12-06T02:39:56.425ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5242024-12-06T02:39:56.532ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5252024-12-06T02:39:56.532ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/zone"), full_name: "oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/zone" } file = sled-storage/src/manager.rs:1331
5262024-12-06T02:39:56.615ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5272024-12-06T02:39:56.615ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crucible" } file = sled-storage/src/manager.rs:1331
5282024-12-06T02:39:56.749ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5292024-12-06T02:39:56.749ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2e1578fd-7835-4cef-bc2c-ab571a943504/crucible" } file = sled-storage/src/manager.rs:1331
5302024-12-06T02:39:56.859ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5312024-12-06T02:39:56.859ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5322024-12-06T02:39:56.968ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5332024-12-06T02:39:56.968ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5342024-12-06T02:39:56.975ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
5352024-12-06T02:39:57.079ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-12-06T02:39:57.079ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/49a626ef-96f9-42b6-8143-bf2801f1f5ea/crypt/zone/oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9"), full_name: "oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea/crypt/zone/oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9" } file = sled-storage/src/manager.rs:1331
5372024-12-06T02:39:57.202ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-12-06T02:39:57.202ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb/crucible" } file = sled-storage/src/manager.rs:1331
5392024-12-06T02:39:57.309ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-12-06T02:39:57.309ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290" } file = sled-storage/src/manager.rs:1331
5412024-12-06T02:39:57.426ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422024-12-06T02:39:57.426ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone/oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2"), full_name: "oxp_2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone/oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2" } file = sled-storage/src/manager.rs:1331
5432024-12-06T02:39:57.539ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5442024-12-06T02:39:57.539ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726/crucible" } file = sled-storage/src/manager.rs:1331
5452024-12-06T02:39:57.653ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5462024-12-06T02:39:57.653ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2770546e-59fa-4ec3-8490-b551f4075d06/crypt/debug"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/debug" } file = sled-storage/src/manager.rs:1331
5472024-12-06T02:39:57.687ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11308210739329693008 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
5482024-12-06T02:39:57.687ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8058229612016537455 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
5492024-12-06T02:39:57.735ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5502024-12-06T02:39:57.735ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d" } file = sled-storage/src/manager.rs:1331
5512024-12-06T02:39:57.852ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-12-06T02:39:57.853ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5532024-12-06T02:39:57.960ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-12-06T02:39:57.960ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/zone/oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113"), full_name: "oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/zone/oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113" } file = sled-storage/src/manager.rs:1331
5552024-12-06T02:39:57.977ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
5562024-12-06T02:39:58.035ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5572024-12-06T02:39:58.035ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5582024-12-06T02:39:58.043ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5592024-12-06T02:39:58.043ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5602024-12-06T02:39:58.088ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-12-06T02:39:58.088ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone/oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone/oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec" } file = sled-storage/src/manager.rs:1331
5622024-12-06T02:39:58.197ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
5632024-12-06T02:39:58.197ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
5642024-12-06T02:39:58.218ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5652024-12-06T02:39:58.218ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone" } file = sled-storage/src/manager.rs:1331
5662024-12-06T02:39:58.242ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
5672024-12-06T02:39:58.242ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
5682024-12-06T02:39:58.298ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
5692024-12-06T02:39:58.298ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
5702024-12-06T02:39:58.308ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5712024-12-06T02:39:58.308ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone/oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone/oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60" } file = sled-storage/src/manager.rs:1331
5722024-12-06T02:39:58.321ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
5732024-12-06T02:39:58.321ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
5742024-12-06T02:39:58.393ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
5752024-12-06T02:39:58.394ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
5762024-12-06T02:39:58.436ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-12-06T02:39:58.436ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda"), full_name: "oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crypt/zone/oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda" } file = sled-storage/src/manager.rs:1331
5782024-12-06T02:39:58.490ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
5792024-12-06T02:39:58.490ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5802024-12-06T02:39:58.530ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
5812024-12-06T02:39:58.530ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/nexus.rs:527 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
5822024-12-06T02:39:58.560ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-12-06T02:39:58.561ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/debug"), full_name: "oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/debug" } file = sled-storage/src/manager.rs:1331
5842024-12-06T02:39:58.575ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
5852024-12-06T02:39:58.575ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
5862024-12-06T02:39:58.575ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
5872024-12-06T02:39:58.575ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
5882024-12-06T02:39:58.623ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
5892024-12-06T02:39:58.646ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5902024-12-06T02:39:58.647ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83a6f053-9a9e-49d7-aa01-2ac3088ef867/crypt/debug"), full_name: "oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867/crypt/debug" } file = sled-storage/src/manager.rs:1331
5912024-12-06T02:39:58.730ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5922024-12-06T02:39:58.730ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3215e18d-10da-4248-a0ac-1e11521027d3/crypt/zone/oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea"), full_name: "oxp_3215e18d-10da-4248-a0ac-1e11521027d3/crypt/zone/oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea" } file = sled-storage/src/manager.rs:1331
5932024-12-06T02:39:58.842ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5942024-12-06T02:39:58.842ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/debug"), full_name: "oxp_2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/debug" } file = sled-storage/src/manager.rs:1331
5952024-12-06T02:39:58.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5962024-12-06T02:39:58.919ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crucible" } file = sled-storage/src/manager.rs:1331
5972024-12-06T02:39:58.979ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
5982024-12-06T02:39:59.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5992024-12-06T02:39:59.022ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/49a626ef-96f9-42b6-8143-bf2801f1f5ea/crypt/zone"), full_name: "oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea/crypt/zone" } file = sled-storage/src/manager.rs:1331
6002024-12-06T02:39:59.108ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6012024-12-06T02:39:59.108ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone/oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad"), full_name: "oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone/oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad" } file = sled-storage/src/manager.rs:1331
6022024-12-06T02:39:59.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6032024-12-06T02:39:59.225ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone/oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8"), full_name: "oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/zone/oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8" } file = sled-storage/src/manager.rs:1331
6042024-12-06T02:39:59.330ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15866858060571901303 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
6052024-12-06T02:39:59.330ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4428700220340669153 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
6062024-12-06T02:39:59.343ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6072024-12-06T02:39:59.343ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
6082024-12-06T02:39:59.452ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6092024-12-06T02:39:59.452ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/debug"), full_name: "oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/debug" } file = sled-storage/src/manager.rs:1331
6102024-12-06T02:39:59.534ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6112024-12-06T02:39:59.534ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone/oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a"), full_name: "oxp_2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/zone/oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a" } file = sled-storage/src/manager.rs:1331
6122024-12-06T02:39:59.650ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6132024-12-06T02:39:59.650ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/zone/oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6"), full_name: "oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/zone/oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6" } file = sled-storage/src/manager.rs:1331
6142024-12-06T02:39:59.766ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6152024-12-06T02:39:59.766ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
6162024-12-06T02:39:59.875ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6172024-12-06T02:39:59.875ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone/oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae"), full_name: "oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/zone/oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae" } file = sled-storage/src/manager.rs:1331
6182024-12-06T02:39:59.982ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
6192024-12-06T02:39:59.992ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6202024-12-06T02:39:59.992ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6212024-12-06T02:39:59.993ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6222024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6232024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6242024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6252024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6262024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6272024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6282024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6292024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6302024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6312024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6322024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6332024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6342024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6352024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6362024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6372024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6382024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6392024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6402024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6412024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6422024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6432024-12-06T02:39:59.993ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6442024-12-06T02:39:59.993ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
6452024-12-06T02:39:59.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6992987 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38209 req_id = f8da1b25-b12a-41f6-8a7a-820f81e2ee7a response_code = 200 uri = /datasets
6462024-12-06T02:40:00.024ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 236597f3-46af-439f-a9c6-4beaac924964 (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2 (service), filesystem_pool: Some(ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1d1790a0-0a7a-477f-ad45-72503586aa19 (service), filesystem_pool: Some(ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6472024-12-06T02:40:00.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53357
6482024-12-06T02:40:00.025ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 236597f3-46af-439f-a9c6-4beaac924964, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6492024-12-06T02:40:00.025ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 236597f3-46af-439f-a9c6-4beaac924964, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6502024-12-06T02:40:00.061ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6512024-12-06T02:40:00.061ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6522024-12-06T02:40:00.095ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1d1790a0-0a7a-477f-ad45-72503586aa19, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6532024-12-06T02:40:00.095ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1d1790a0-0a7a-477f-ad45-72503586aa19, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6542024-12-06T02:40:00.126ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6552024-12-06T02:40:00.126ZINFOSledAgent (ServiceManager): No ledger in /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-zones.json file = common/src/ledger.rs:188
6562024-12-06T02:40:00.126ZINFOSledAgent (ServiceManager): No ledger in /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-zones.json file = common/src/ledger.rs:188
6572024-12-06T02:40:00.127ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6582024-12-06T02:40:00.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6592024-12-06T02:40:00.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6602024-12-06T02:40:00.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6612024-12-06T02:40:00.224ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2 file = illumos-utils/src/zone.rs:325
6622024-12-06T02:40:00.228ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964 file = illumos-utils/src/zone.rs:325
6632024-12-06T02:40:00.232ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19 file = illumos-utils/src/zone.rs:325
6642024-12-06T02:40:00.245ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2 file = illumos-utils/src/zone.rs:363
6652024-12-06T02:40:00.249ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964 file = illumos-utils/src/zone.rs:363
6662024-12-06T02:40:00.253ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19 file = illumos-utils/src/zone.rs:363
6672024-12-06T02:40:00.531ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/nexus.rs:527 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
6682024-12-06T02:40:00.984ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5455a27f-b1dd-4d8d-adde-726221dabebe) file = sled-agent/src/probe_manager.rs:231 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
6692024-12-06T02:40:01.825ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6702024-12-06T02:40:01.826ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6712024-12-06T02:40:01.826ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2
6722024-12-06T02:40:02.313ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6732024-12-06T02:40:02.796ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6742024-12-06T02:40:02.797ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6752024-12-06T02:40:02.797ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6762024-12-06T02:40:02.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2") failed: Property not found. retry in 54.180568ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2
6772024-12-06T02:40:02.804ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964
6782024-12-06T02:40:02.808ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
6792024-12-06T02:40:02.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2") failed: Property not found. retry in 74.24656ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2
6802024-12-06T02:40:02.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19") failed: Property not found. retry in 35.376702ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
6812024-12-06T02:40:02.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964") failed: Property not found. retry in 63.100644ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964
6822024-12-06T02:40:02.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2") failed: Property not found. retry in 245.119219ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2
6832024-12-06T02:40:02.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19") failed: Property not found. retry in 59.570365ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
6842024-12-06T02:40:03.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964") failed: Property not found. retry in 126.282415ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964
6852024-12-06T02:40:03.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2") failed: Property not found. retry in 321.063896ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2
6862024-12-06T02:40:03.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19") failed: Property not found. retry in 192.831311ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
6872024-12-06T02:40:03.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964") failed: Property not found. retry in 193.8791ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964
6882024-12-06T02:40:03.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19") failed: Property not found. retry in 348.346142ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
6892024-12-06T02:40:03.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2") failed: Property not found. retry in 1.086944829s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2
6902024-12-06T02:40:03.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964") failed: Property not found. retry in 493.242034ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964
6912024-12-06T02:40:03.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19") failed: Property not found. retry in 981.589472ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
6922024-12-06T02:40:04.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964") failed: Property not found. retry in 806.172781ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964
6932024-12-06T02:40:04.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2") failed: Property not found. retry in 799.190231ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2
6942024-12-06T02:40:04.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19") failed: Property not found. retry in 922.684667ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
6952024-12-06T02:40:04.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964") failed: Property not found. retry in 694.702151ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964
6962024-12-06T02:40:05.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2") failed: Property not found. retry in 1.361301459s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2
6972024-12-06T02:40:05.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964") failed: Property not found. retry in 1.058289182s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964
6982024-12-06T02:40:05.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19") failed: Property not found. retry in 1.19599252s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
6992024-12-06T02:40:06.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964") failed: Property not found. retry in 1.400045119s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964
7002024-12-06T02:40:06.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2") failed: Property not found. retry in 1.269541296s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2
7012024-12-06T02:40:07.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19") failed: Property not found. retry in 954.864667ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
7022024-12-06T02:40:07.689ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11308210739329693008 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7032024-12-06T02:40:07.689ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8058229612016537455 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7042024-12-06T02:40:07.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19") failed: Property not found. retry in 1.238086533s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
7052024-12-06T02:40:09.230ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_0f7f8b64-a9b9-4167-a80d-ed20e451d7b2
7062024-12-06T02:40:09.230ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_236597f3-46af-439f-a9c6-4beaac924964
7072024-12-06T02:40:09.230ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_1d1790a0-0a7a-477f-ad45-72503586aa19
7082024-12-06T02:40:09.230ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7092024-12-06T02:40:09.230ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7102024-12-06T02:40:09.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9206023 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53357 req_id = d5698bd7-6bc4-4d05-88c1-3aaf88f05afe response_code = 204 uri = /omicron-zones
7112024-12-06T02:40:09.233ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7122024-12-06T02:40:09.288ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7132024-12-06T02:40:09.331ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15866858060571901303 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7142024-12-06T02:40:09.331ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4428700220340669153 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7152024-12-06T02:40:09.350ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7162024-12-06T02:40:09.407ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7172024-12-06T02:40:09.407ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7182024-12-06T02:40:09.439ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7192024-12-06T02:40:09.440ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7202024-12-06T02:40:09.440ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7212024-12-06T02:40:09.469ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 236597f3-46af-439f-a9c6-4beaac924964 (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2 (service), filesystem_pool: Some(ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1d1790a0-0a7a-477f-ad45-72503586aa19 (service), filesystem_pool: Some(ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: d3e77222-5c94-4b90-9550-28b77b9012b9 (service), filesystem_pool: Some(ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 34862fb1-ed3a-4d12-9fa9-64447874e456, kind: Service { id: d3e77222-5c94-4b90-9550-28b77b9012b9 }, name: Name("ntp-d3e77222-5c94-4b90-9550-28b77b9012b9"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 236])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7222024-12-06T02:40:09.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44128
7232024-12-06T02:40:09.469ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 236597f3-46af-439f-a9c6-4beaac924964, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7242024-12-06T02:40:09.469ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 236597f3-46af-439f-a9c6-4beaac924964, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7252024-12-06T02:40:09.511ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7262024-12-06T02:40:09.511ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7272024-12-06T02:40:09.550ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1d1790a0-0a7a-477f-ad45-72503586aa19, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7282024-12-06T02:40:09.550ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1d1790a0-0a7a-477f-ad45-72503586aa19, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7292024-12-06T02:40:09.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7302024-12-06T02:40:09.586ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-zones.json file = common/src/ledger.rs:177
7312024-12-06T02:40:09.586ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-zones.json file = common/src/ledger.rs:177
7322024-12-06T02:40:09.587ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7332024-12-06T02:40:09.597ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7342024-12-06T02:40:09.630ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7352024-12-06T02:40:09.631ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7362024-12-06T02:40:09.631ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7372024-12-06T02:40:09.660ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 203, 236]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7382024-12-06T02:40:09.660ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7392024-12-06T02:40:09.661ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7402024-12-06T02:40:09.661ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7412024-12-06T02:40:09.661ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7422024-12-06T02:40:09.661ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7432024-12-06T02:40:09.685ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9 file = illumos-utils/src/zone.rs:325
7442024-12-06T02:40:09.703ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9 file = illumos-utils/src/zone.rs:363
7452024-12-06T02:40:10.330ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7462024-12-06T02:40:10.330ZINFOSledAgent (ServiceManager): Booting oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7472024-12-06T02:40:10.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9") failed: Property not found. retry in 62.36472ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7482024-12-06T02:40:10.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9") failed: Property not found. retry in 106.320944ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7492024-12-06T02:40:10.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9") failed: Property not found. retry in 152.515964ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7502024-12-06T02:40:10.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9") failed: Property not found. retry in 386.009753ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7512024-12-06T02:40:11.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9") failed: Property not found. retry in 933.279698ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7522024-12-06T02:40:12.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9") failed: Property not found. retry in 983.853521ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7532024-12-06T02:40:13.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9") failed: Property not found. retry in 640.222685ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7542024-12-06T02:40:13.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9") failed: Property not found. retry in 1.439177979s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7552024-12-06T02:40:15.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9") failed: Property not found. retry in 855.16723ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7562024-12-06T02:40:16.131ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9
7572024-12-06T02:40:16.131ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7582024-12-06T02:40:16.131ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7592024-12-06T02:40:16.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6662584 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44128 req_id = 3fae2393-e6b2-4201-8b0a-0d75c66f9b46 response_code = 204 uri = /omicron-zones
7602024-12-06T02:40:16.134ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
7612024-12-06T02:40:16.163ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7622024-12-06T02:40:16.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32929
7632024-12-06T02:40:16.171ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7642024-12-06T02:40:16.171ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7605 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32929 req_id = 6c0a4d93-fd4f-4fe9-a033-6a7d5d65d726 response_code = 500 uri = /timesync
7652024-12-06T02:40:16.173ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7662024-12-06T02:40:16.301ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7672024-12-06T02:40:16.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60520
7682024-12-06T02:40:17.690ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11308210739329693008 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7692024-12-06T02:40:17.691ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8058229612016537455 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7702024-12-06T02:40:18.157ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 390981260518720764 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7712024-12-06T02:40:18.206ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17718320556226120893 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7722024-12-06T02:40:19.233ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1183960929992646533 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7732024-12-06T02:40:19.333ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15866858060571901303 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7742024-12-06T02:40:19.333ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4428700220340669153 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7752024-12-06T02:40:20.309ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7762024-12-06T02:40:20.309ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4007830 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60520 req_id = ddd4ccb9-dfbb-4433-a336-e1972c849e29 response_code = 500 uri = /timesync
7772024-12-06T02:40:20.311ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7782024-12-06T02:40:20.448ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7792024-12-06T02:40:20.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44173
7802024-12-06T02:40:20.456ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7812024-12-06T02:40:20.456ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7822 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44173 req_id = 53970eaa-e184-4c4f-98ac-5a14c0049930 response_code = 500 uri = /timesync
7822024-12-06T02:40:20.458ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7832024-12-06T02:40:20.607ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7842024-12-06T02:40:20.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45052
7852024-12-06T02:40:24.783ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_d3e77222-5c94-4b90-9550-28b77b9012b9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7862024-12-06T02:40:24.783ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009019 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45052 req_id = 2a9e39d8-f33d-4c06-8a98-c99984a42aac response_code = 500 uri = /timesync
7872024-12-06T02:40:24.786ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7882024-12-06T02:40:24.934ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7892024-12-06T02:40:24.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64440
7902024-12-06T02:40:24.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64440 req_id = 708c8846-9ec4-4cae-98fb-28614833b1d6 response_code = 200 uri = /timesync
7912024-12-06T02:40:24.944ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.014189677 } file = sled-agent/src/rack_setup/service.rs:743
7922024-12-06T02:40:24.944ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7932024-12-06T02:40:25.134ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7942024-12-06T02:40:25.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61555
7952024-12-06T02:40:25.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7868 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61555 req_id = ac4b10ea-6454-4005-b556-3695f42cd5fb response_code = 200 uri = /timesync
7962024-12-06T02:40:25.144ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.013647798 } file = sled-agent/src/rack_setup/service.rs:743
7972024-12-06T02:40:25.144ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7982024-12-06T02:40:25.232ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 145.578211ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
7992024-12-06T02:40:25.543ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8002024-12-06T02:40:25.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59008
8012024-12-06T02:40:25.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59008 req_id = 275fef82-64ce-4379-88b2-977aba41c101 response_code = 200 uri = /timesync
8022024-12-06T02:40:25.553ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.017068526 } file = sled-agent/src/rack_setup/service.rs:743
8032024-12-06T02:40:25.553ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8042024-12-06T02:40:25.770ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8052024-12-06T02:40:25.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55115
8062024-12-06T02:40:25.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7630 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55115 req_id = 084ad947-c597-4582-9551-2448e74f7762 response_code = 200 uri = /timesync
8072024-12-06T02:40:25.780ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.016452301 } file = sled-agent/src/rack_setup/service.rs:743
8082024-12-06T02:40:25.780ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8092024-12-06T02:40:26.008ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8102024-12-06T02:40:26.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60636
8112024-12-06T02:40:26.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7679 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60636 req_id = e4453983-f0b9-4558-a1f7-f40d7fc9d815 response_code = 200 uri = /timesync
8122024-12-06T02:40:26.019ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.015804615 } file = sled-agent/src/rack_setup/service.rs:743
8132024-12-06T02:40:26.019ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8142024-12-06T02:40:26.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3737987888543163003 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
8152024-12-06T02:40:26.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12690973929121260691 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
8162024-12-06T02:40:26.363ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8172024-12-06T02:40:26.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62927
8182024-12-06T02:40:26.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62927 req_id = ffa2643a-6aed-44c2-bf9f-187f30c1b6c0 response_code = 200 uri = /timesync
8192024-12-06T02:40:26.372ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.014844015 } file = sled-agent/src/rack_setup/service.rs:743
8202024-12-06T02:40:26.372ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8212024-12-06T02:40:27.170ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8222024-12-06T02:40:27.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35789
8232024-12-06T02:40:27.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35789 req_id = da665018-67bf-4dc3-b436-3556ba126a69 response_code = 200 uri = /timesync
8242024-12-06T02:40:27.181ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.013099974 } file = sled-agent/src/rack_setup/service.rs:743
8252024-12-06T02:40:27.181ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8262024-12-06T02:40:27.852ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11308210739329693008 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
8272024-12-06T02:40:27.852ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8058229612016537455 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
8282024-12-06T02:40:27.941ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8292024-12-06T02:40:27.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37981
8302024-12-06T02:40:27.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7840 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37981 req_id = 1d1ea81e-976e-4d08-b55d-095d976fac08 response_code = 200 uri = /timesync
8312024-12-06T02:40:27.951ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733452826.017656, correction: -0.009636042 } file = sled-agent/src/rack_setup/service.rs:743
8322024-12-06T02:40:27.951ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8332024-12-06T02:40:28.318ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 390981260518720764 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
8342024-12-06T02:40:28.365ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17718320556226120893 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
8352024-12-06T02:40:28.378ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58043
8362024-12-06T02:40:28.378ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58043 req_id = 884ceb57-5c5b-4422-b195-8702379afd92 response_code = 200 uri = /baseboard
8372024-12-06T02:40:29.040ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8382024-12-06T02:40:29.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37110
8392024-12-06T02:40:29.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21098 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37110 req_id = 98ebdb1c-30fd-40d7-b55b-c9d71d92ae10 response_code = 200 uri = /timesync
8402024-12-06T02:40:29.063ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1823857758, ip_addr: 108.181.220.94, stratum: 5, ref_time: 1733452827.7997875, correction: -0.005497031 } file = sled-agent/src/rack_setup/service.rs:743
8412024-12-06T02:40:29.063ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8422024-12-06T02:40:29.094ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 236597f3-46af-439f-a9c6-4beaac924964 (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2 (service), filesystem_pool: Some(ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1d1790a0-0a7a-477f-ad45-72503586aa19 (service), filesystem_pool: Some(ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: d3e77222-5c94-4b90-9550-28b77b9012b9 (service), filesystem_pool: Some(ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 34862fb1-ed3a-4d12-9fa9-64447874e456, kind: Service { id: d3e77222-5c94-4b90-9550-28b77b9012b9 }, name: Name("ntp-d3e77222-5c94-4b90-9550-28b77b9012b9"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 236])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3d3cd6ad-0040-498e-817f-8dc4ddb33f6d (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d55ea32-3670-4a16-bffe-18ff1661ce60 (service), filesystem_pool: Some(ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External } } } }, OmicronZoneConfig { id: ddd09705-0065-4e51-95af-210d8ab547b0 (service), filesystem_pool: Some(ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External } } } }, OmicronZoneConfig { id: b98aa053-95c9-47b8-8934-a798935746f6 (service), filesystem_pool: Some(ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External } } } }, OmicronZoneConfig { id: 87a17acd-4951-40ee-a159-70115b1710a2 (service), filesystem_pool: Some(ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8432024-12-06T02:40:29.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34263
8442024-12-06T02:40:29.094ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 236597f3-46af-439f-a9c6-4beaac924964, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8452024-12-06T02:40:29.094ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 236597f3-46af-439f-a9c6-4beaac924964, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8462024-12-06T02:40:29.130ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8472024-12-06T02:40:29.130ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8482024-12-06T02:40:29.165ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1d1790a0-0a7a-477f-ad45-72503586aa19, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8492024-12-06T02:40:29.165ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1d1790a0-0a7a-477f-ad45-72503586aa19, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8502024-12-06T02:40:29.201ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3d3cd6ad-0040-498e-817f-8dc4ddb33f6d, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8512024-12-06T02:40:29.201ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3d3cd6ad-0040-498e-817f-8dc4ddb33f6d, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8522024-12-06T02:40:29.232ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d55ea32-3670-4a16-bffe-18ff1661ce60, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8532024-12-06T02:40:29.232ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7d55ea32-3670-4a16-bffe-18ff1661ce60, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8542024-12-06T02:40:29.265ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ddd09705-0065-4e51-95af-210d8ab547b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8552024-12-06T02:40:29.265ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ddd09705-0065-4e51-95af-210d8ab547b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8562024-12-06T02:40:29.296ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b98aa053-95c9-47b8-8934-a798935746f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8572024-12-06T02:40:29.296ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b98aa053-95c9-47b8-8934-a798935746f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8582024-12-06T02:40:29.327ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87a17acd-4951-40ee-a159-70115b1710a2, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8592024-12-06T02:40:29.328ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 87a17acd-4951-40ee-a159-70115b1710a2, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8602024-12-06T02:40:29.360ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8612024-12-06T02:40:29.360ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-zones.json file = common/src/ledger.rs:177
8622024-12-06T02:40:29.361ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-zones.json file = common/src/ledger.rs:177
8632024-12-06T02:40:29.361ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8642024-12-06T02:40:29.444ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8652024-12-06T02:40:29.444ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8662024-12-06T02:40:29.444ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8672024-12-06T02:40:29.444ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8682024-12-06T02:40:29.444ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8692024-12-06T02:40:29.537ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6 file = illumos-utils/src/zone.rs:325
8702024-12-06T02:40:29.541ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d file = illumos-utils/src/zone.rs:325
8712024-12-06T02:40:29.546ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60 file = illumos-utils/src/zone.rs:325
8722024-12-06T02:40:29.550ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0 file = illumos-utils/src/zone.rs:325
8732024-12-06T02:40:29.554ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2 file = illumos-utils/src/zone.rs:325
8742024-12-06T02:40:29.559ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6 file = illumos-utils/src/zone.rs:363
8752024-12-06T02:40:29.564ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d file = illumos-utils/src/zone.rs:363
8762024-12-06T02:40:29.568ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60 file = illumos-utils/src/zone.rs:363
8772024-12-06T02:40:29.573ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0 file = illumos-utils/src/zone.rs:363
8782024-12-06T02:40:29.577ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2 file = illumos-utils/src/zone.rs:363
8792024-12-06T02:40:32.497ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7d55ea32-3670-4a16-bffe-18ff1661ce60'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8802024-12-06T02:40:32.497ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
8812024-12-06T02:40:32.503ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='87a17acd-4951-40ee-a159-70115b1710a2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8822024-12-06T02:40:32.503ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
8832024-12-06T02:40:32.508ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3d3cd6ad-0040-498e-817f-8dc4ddb33f6d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8842024-12-06T02:40:32.508ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
8852024-12-06T02:40:32.520ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ddd09705-0065-4e51-95af-210d8ab547b0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8862024-12-06T02:40:32.521ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
8872024-12-06T02:40:32.534ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b98aa053-95c9-47b8-8934-a798935746f6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8882024-12-06T02:40:32.534ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
8892024-12-06T02:40:32.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 51.488325ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
8902024-12-06T02:40:32.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 46.226681ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
8912024-12-06T02:40:32.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 32.623274ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
8922024-12-06T02:40:32.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 33.881467ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
8932024-12-06T02:40:32.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 30.303684ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
8942024-12-06T02:40:32.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 142.709944ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
8952024-12-06T02:40:32.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 99.85338ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
8962024-12-06T02:40:32.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 125.184991ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
8972024-12-06T02:40:32.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 97.867763ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
8982024-12-06T02:40:32.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 230.726797ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
8992024-12-06T02:40:32.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 126.172922ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9002024-12-06T02:40:33.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 225.404454ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9012024-12-06T02:40:33.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 251.028179ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9022024-12-06T02:40:33.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 191.073337ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9032024-12-06T02:40:33.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 588.780379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9042024-12-06T02:40:33.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 177.729002ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9052024-12-06T02:40:34.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 296.10059ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9062024-12-06T02:40:34.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 399.384136ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9072024-12-06T02:40:35.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 300.663761ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9082024-12-06T02:40:35.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 1.028844683s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9092024-12-06T02:40:35.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 337.535885ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9102024-12-06T02:40:35.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 577.208616ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9112024-12-06T02:40:35.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 1.095369975s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9122024-12-06T02:40:35.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 434.584001ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9132024-12-06T02:40:35.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 601.351613ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9142024-12-06T02:40:35.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 802.212551ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9152024-12-06T02:40:35.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 887.526937ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9162024-12-06T02:40:36.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 674.404455ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9172024-12-06T02:40:36.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 643.48756ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9182024-12-06T02:40:36.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 504.883299ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9192024-12-06T02:40:36.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 1.069399523s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9202024-12-06T02:40:36.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 783.597935ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9212024-12-06T02:40:36.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 860.876517ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9222024-12-06T02:40:36.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 1.170051169s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9232024-12-06T02:40:36.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 614.371299ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9242024-12-06T02:40:37.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 1.429052586s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9252024-12-06T02:40:37.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 867.69934ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9262024-12-06T02:40:37.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 913.383765ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9272024-12-06T02:40:37.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 638.476382ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9282024-12-06T02:40:38.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 1.081904582s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9292024-12-06T02:40:38.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 589.127796ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9302024-12-06T02:40:38.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 649.385241ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9312024-12-06T02:40:38.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 698.967869ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9322024-12-06T02:40:39.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 1.485856703s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9332024-12-06T02:40:39.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 1.239744456s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9342024-12-06T02:40:39.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 949.877585ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9352024-12-06T02:40:39.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 1.05056091s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9362024-12-06T02:40:39.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 920.649455ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9372024-12-06T02:40:40.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 541.322909ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9382024-12-06T02:40:40.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 1.339379073s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9392024-12-06T02:40:40.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 1.493628434s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9402024-12-06T02:40:40.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 773.525974ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9412024-12-06T02:40:40.398ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 732.896934ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
9422024-12-06T02:40:40.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 1.15077904s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9432024-12-06T02:40:40.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 758.777483ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9442024-12-06T02:40:41.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 837.626802ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9452024-12-06T02:40:41.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 545.633736ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9462024-12-06T02:40:41.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 595.186311ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9472024-12-06T02:40:41.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 1.323012764s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9482024-12-06T02:40:41.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 1.040156829s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9492024-12-06T02:40:41.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 1.35288487s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9502024-12-06T02:40:41.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 1.339112293s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9512024-12-06T02:40:42.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 620.090874ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9522024-12-06T02:40:42.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 864.403428ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9532024-12-06T02:40:42.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 543.850167ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9542024-12-06T02:40:42.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 1.353033259s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9552024-12-06T02:40:43.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 1.16234729s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9562024-12-06T02:40:43.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 1.182851847s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9572024-12-06T02:40:43.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 1.441891808s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9582024-12-06T02:40:43.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 1.351106948s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9592024-12-06T02:40:44.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 665.20447ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9602024-12-06T02:40:44.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 1.00313679s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9612024-12-06T02:40:44.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 1.387816041s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9622024-12-06T02:40:44.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 681.165325ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9632024-12-06T02:40:45.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 999.482407ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9642024-12-06T02:40:45.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 789.046399ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9652024-12-06T02:40:45.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 869.272116ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9662024-12-06T02:40:45.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 778.652225ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9672024-12-06T02:40:45.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 863.951702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9682024-12-06T02:40:45.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 636.267436ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9692024-12-06T02:40:46.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 639.896067ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9702024-12-06T02:40:46.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 1.323058588s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9712024-12-06T02:40:46.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 571.462208ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9722024-12-06T02:40:46.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 1.020746745s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9732024-12-06T02:40:46.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 1.27310273s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9742024-12-06T02:40:46.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 1.123843019s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9752024-12-06T02:40:46.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 891.699797ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9762024-12-06T02:40:47.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 979.091549ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9772024-12-06T02:40:47.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 523.349519ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9782024-12-06T02:40:47.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d") failed: Property not found. retry in 983.597286ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9792024-12-06T02:40:47.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 990.462759ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9802024-12-06T02:40:47.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 1.029374806s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9812024-12-06T02:40:48.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60") failed: Property not found. retry in 1.258184893s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9822024-12-06T02:40:48.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2") failed: Property not found. retry in 544.07385ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9832024-12-06T02:40:48.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0") failed: Property not found. retry in 1.416524118s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9842024-12-06T02:40:49.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6") failed: Property not found. retry in 887.752377ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9852024-12-06T02:40:50.317ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_b98aa053-95c9-47b8-8934-a798935746f6
9862024-12-06T02:40:50.317ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_3d3cd6ad-0040-498e-817f-8dc4ddb33f6d
9872024-12-06T02:40:50.317ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_7d55ea32-3670-4a16-bffe-18ff1661ce60
9882024-12-06T02:40:50.317ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_ddd09705-0065-4e51-95af-210d8ab547b0
9892024-12-06T02:40:50.317ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_87a17acd-4951-40ee-a159-70115b1710a2
9902024-12-06T02:40:50.317ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9912024-12-06T02:40:50.317ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9922024-12-06T02:40:50.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21228081 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34263 req_id = 146c95cb-f39f-4dd3-bc93-987972c190c7 response_code = 204 uri = /omicron-zones
9932024-12-06T02:40:50.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41351
9942024-12-06T02:40:50.381ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3743
9952024-12-06T02:41:03.417ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
9962024-12-06T02:41:12.242ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
9972024-12-06T02:41:12.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21889534 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41351 req_id = 1b15030f-ff0c-4a78-ab54-17cea7319170 response_code = 204 uri = /cockroachdb
9982024-12-06T02:41:12.242ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60094
9992024-12-06T02:41:12.243ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60094 req_id = 52e3b431-b237-45e4-82c3-bec842c002ce response_code = 200 uri = /baseboard
10002024-12-06T02:41:12.247ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.479278114s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
10012024-12-06T02:41:12.278ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 236597f3-46af-439f-a9c6-4beaac924964 (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2 (service), filesystem_pool: Some(ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1d1790a0-0a7a-477f-ad45-72503586aa19 (service), filesystem_pool: Some(ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: d3e77222-5c94-4b90-9550-28b77b9012b9 (service), filesystem_pool: Some(ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 34862fb1-ed3a-4d12-9fa9-64447874e456, kind: Service { id: d3e77222-5c94-4b90-9550-28b77b9012b9 }, name: Name("ntp-d3e77222-5c94-4b90-9550-28b77b9012b9"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 236])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3d3cd6ad-0040-498e-817f-8dc4ddb33f6d (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d55ea32-3670-4a16-bffe-18ff1661ce60 (service), filesystem_pool: Some(ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External } } } }, OmicronZoneConfig { id: ddd09705-0065-4e51-95af-210d8ab547b0 (service), filesystem_pool: Some(ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External } } } }, OmicronZoneConfig { id: b98aa053-95c9-47b8-8934-a798935746f6 (service), filesystem_pool: Some(ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External } } } }, OmicronZoneConfig { id: 87a17acd-4951-40ee-a159-70115b1710a2 (service), filesystem_pool: Some(ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External } } } }, OmicronZoneConfig { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e (service), filesystem_pool: Some(ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 (service), filesystem_pool: Some(ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3943088e-6ce0-4ada-925c-494df92c0dda (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 (service), filesystem_pool: Some(ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a3056c3a-712e-4eef-91fb-ab53fb7138ad (service), filesystem_pool: Some(ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 9da9ecff-1155-48cf-ab8c-84d23c860290 (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External } } } }, OmicronZoneConfig { id: 91d36286-1f73-4c81-8334-148353b10bf1 (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: d021c8bc-ba6f-4e09-8223-e21d77f943d8 (service), filesystem_pool: Some(ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: da5e8b0f-29f2-458f-8bba-dcd5fad613fd (service), filesystem_pool: Some(ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: ce91f9d7-c7d1-4de8-a07c-f487d71f1526 (service), filesystem_pool: Some(ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External } } } }, OmicronZoneConfig { id: 910f4385-61c7-47ed-9825-264cb34321ec (service), filesystem_pool: Some(ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External } } } }, OmicronZoneConfig { id: a7677aed-c870-4cbb-898e-35dbe1020cae (service), filesystem_pool: Some(ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40689173-b5ff-4c49-b401-2c6da404b113 (service), filesystem_pool: Some(ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External } } } }, OmicronZoneConfig { id: a2172227-b31a-44ad-8e86-01b1df448d3a (service), filesystem_pool: Some(ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External } } } }, OmicronZoneConfig { id: c318d295-50ed-4662-8b85-b8c4ac4d4e81 (service), filesystem_pool: Some(ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External } } } }, OmicronZoneConfig { id: acd10f4a-0273-47b8-ace5-7f14700186ea (service), filesystem_pool: Some(ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External } } } }, OmicronZoneConfig { id: b119f655-8e72-4930-bca9-26e8985a42c4 (service), filesystem_pool: Some(ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External } } } }, OmicronZoneConfig { id: a9466476-412a-455d-a52b-9e4ed2fa1227 (service), filesystem_pool: Some(ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10022024-12-06T02:41:12.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49061
10032024-12-06T02:41:12.278ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 236597f3-46af-439f-a9c6-4beaac924964, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10042024-12-06T02:41:12.278ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 236597f3-46af-439f-a9c6-4beaac924964, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10052024-12-06T02:41:12.474ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10062024-12-06T02:41:12.474ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f7f8b64-a9b9-4167-a80d-ed20e451d7b2, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10072024-12-06T02:41:12.534ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1d1790a0-0a7a-477f-ad45-72503586aa19, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10082024-12-06T02:41:12.534ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1d1790a0-0a7a-477f-ad45-72503586aa19, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10092024-12-06T02:41:12.608ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3d3cd6ad-0040-498e-817f-8dc4ddb33f6d, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10102024-12-06T02:41:12.608ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3d3cd6ad-0040-498e-817f-8dc4ddb33f6d, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10112024-12-06T02:41:12.661ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d55ea32-3670-4a16-bffe-18ff1661ce60, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10122024-12-06T02:41:12.661ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7d55ea32-3670-4a16-bffe-18ff1661ce60, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10132024-12-06T02:41:12.717ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ddd09705-0065-4e51-95af-210d8ab547b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10142024-12-06T02:41:12.717ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ddd09705-0065-4e51-95af-210d8ab547b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10152024-12-06T02:41:12.762ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b98aa053-95c9-47b8-8934-a798935746f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10162024-12-06T02:41:12.762ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b98aa053-95c9-47b8-8934-a798935746f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10172024-12-06T02:41:12.808ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87a17acd-4951-40ee-a159-70115b1710a2, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10182024-12-06T02:41:12.808ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 87a17acd-4951-40ee-a159-70115b1710a2, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10192024-12-06T02:41:12.857ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 978be6b7-c081-4ef5-81fb-d8f564b5837d, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10202024-12-06T02:41:12.858ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 978be6b7-c081-4ef5-81fb-d8f564b5837d, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10212024-12-06T02:41:12.924ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8862fdaf-bee3-4548-a137-b8038fc2a53e, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10222024-12-06T02:41:12.924ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8862fdaf-bee3-4548-a137-b8038fc2a53e, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10232024-12-06T02:41:12.967ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9da9ecff-1155-48cf-ab8c-84d23c860290, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
10242024-12-06T02:41:12.967ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9da9ecff-1155-48cf-ab8c-84d23c860290, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10252024-12-06T02:41:13.010ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ce91f9d7-c7d1-4de8-a07c-f487d71f1526, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10262024-12-06T02:41:13.010ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ce91f9d7-c7d1-4de8-a07c-f487d71f1526, dataset_name: DatasetName { pool_name: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, kind: Crucible }, responder: ... }
10272024-12-06T02:41:13.057ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 910f4385-61c7-47ed-9825-264cb34321ec, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10282024-12-06T02:41:13.057ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 910f4385-61c7-47ed-9825-264cb34321ec, dataset_name: DatasetName { pool_name: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, kind: Crucible }, responder: ... }
10292024-12-06T02:41:13.107ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a7677aed-c870-4cbb-898e-35dbe1020cae, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10302024-12-06T02:41:13.107ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a7677aed-c870-4cbb-898e-35dbe1020cae, dataset_name: DatasetName { pool_name: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, kind: Crucible }, responder: ... }
10312024-12-06T02:41:13.162ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 40689173-b5ff-4c49-b401-2c6da404b113, dataset_name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10322024-12-06T02:41:13.162ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 40689173-b5ff-4c49-b401-2c6da404b113, dataset_name: DatasetName { pool_name: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, kind: Crucible }, responder: ... }
10332024-12-06T02:41:13.228ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a2172227-b31a-44ad-8e86-01b1df448d3a, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10342024-12-06T02:41:13.228ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a2172227-b31a-44ad-8e86-01b1df448d3a, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, kind: Crucible }, responder: ... }
10352024-12-06T02:41:13.280ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c318d295-50ed-4662-8b85-b8c4ac4d4e81, dataset_name: DatasetName { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10362024-12-06T02:41:13.280ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c318d295-50ed-4662-8b85-b8c4ac4d4e81, dataset_name: DatasetName { pool_name: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, kind: Crucible }, responder: ... }
10372024-12-06T02:41:13.349ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: acd10f4a-0273-47b8-ace5-7f14700186ea, dataset_name: DatasetName { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10382024-12-06T02:41:13.349ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: acd10f4a-0273-47b8-ace5-7f14700186ea, dataset_name: DatasetName { pool_name: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10392024-12-06T02:41:13.438ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b119f655-8e72-4930-bca9-26e8985a42c4, dataset_name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10402024-12-06T02:41:13.438ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b119f655-8e72-4930-bca9-26e8985a42c4, dataset_name: DatasetName { pool_name: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, kind: Crucible }, responder: ... }
10412024-12-06T02:41:13.498ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a9466476-412a-455d-a52b-9e4ed2fa1227, dataset_name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10422024-12-06T02:41:13.498ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a9466476-412a-455d-a52b-9e4ed2fa1227, dataset_name: DatasetName { pool_name: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, kind: Crucible }, responder: ... }
10432024-12-06T02:41:13.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10442024-12-06T02:41:13.581ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-zones.json file = common/src/ledger.rs:177
10452024-12-06T02:41:13.581ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-zones.json file = common/src/ledger.rs:177
10462024-12-06T02:41:13.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10472024-12-06T02:41:13.705ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10482024-12-06T02:41:13.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10492024-12-06T02:41:13.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10502024-12-06T02:41:13.754ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10512024-12-06T02:41:13.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10522024-12-06T02:41:13.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10532024-12-06T02:41:13.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10542024-12-06T02:41:13.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10552024-12-06T02:41:13.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10562024-12-06T02:41:13.766ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10572024-12-06T02:41:13.935ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10582024-12-06T02:41:13.936ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10592024-12-06T02:41:13.949ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10602024-12-06T02:41:13.949ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10612024-12-06T02:41:13.949ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10622024-12-06T02:41:13.973ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10632024-12-06T02:41:13.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10642024-12-06T02:41:13.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10652024-12-06T02:41:13.985ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10662024-12-06T02:41:13.986ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8 file = illumos-utils/src/zone.rs:325
10672024-12-06T02:41:13.991ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113 file = illumos-utils/src/zone.rs:325
10682024-12-06T02:41:13.995ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227 file = illumos-utils/src/zone.rs:325
10692024-12-06T02:41:14.000ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad file = illumos-utils/src/zone.rs:325
10702024-12-06T02:41:14.005ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1 file = illumos-utils/src/zone.rs:325
10712024-12-06T02:41:14.010ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526 file = illumos-utils/src/zone.rs:325
10722024-12-06T02:41:14.015ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec file = illumos-utils/src/zone.rs:325
10732024-12-06T02:41:14.020ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a file = illumos-utils/src/zone.rs:325
10742024-12-06T02:41:14.137ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8 file = illumos-utils/src/zone.rs:363
10752024-12-06T02:41:14.141ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113 file = illumos-utils/src/zone.rs:363
10762024-12-06T02:41:14.146ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227 file = illumos-utils/src/zone.rs:363
10772024-12-06T02:41:14.151ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad file = illumos-utils/src/zone.rs:363
10782024-12-06T02:41:14.155ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1 file = illumos-utils/src/zone.rs:363
10792024-12-06T02:41:14.159ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526 file = illumos-utils/src/zone.rs:363
10802024-12-06T02:41:14.163ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec file = illumos-utils/src/zone.rs:363
10812024-12-06T02:41:14.168ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a file = illumos-utils/src/zone.rs:363
10822024-12-06T02:41:14.173ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae file = illumos-utils/src/zone.rs:325
10832024-12-06T02:41:14.178ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd file = illumos-utils/src/zone.rs:325
10842024-12-06T02:41:14.183ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81 file = illumos-utils/src/zone.rs:325
10852024-12-06T02:41:14.189ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290 file = illumos-utils/src/zone.rs:325
10862024-12-06T02:41:14.196ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea file = illumos-utils/src/zone.rs:325
10872024-12-06T02:41:14.202ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4 file = illumos-utils/src/zone.rs:325
10882024-12-06T02:41:14.208ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae file = illumos-utils/src/zone.rs:363
10892024-12-06T02:41:14.215ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd file = illumos-utils/src/zone.rs:363
10902024-12-06T02:41:14.222ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81 file = illumos-utils/src/zone.rs:363
10912024-12-06T02:41:14.229ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290 file = illumos-utils/src/zone.rs:363
10922024-12-06T02:41:14.236ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea file = illumos-utils/src/zone.rs:363
10932024-12-06T02:41:14.245ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4 file = illumos-utils/src/zone.rs:363
10942024-12-06T02:41:14.319ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10952024-12-06T02:41:14.405ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10962024-12-06T02:41:14.464ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10972024-12-06T02:41:14.521ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10982024-12-06T02:41:14.668ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10992024-12-06T02:41:14.669ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11002024-12-06T02:41:14.669ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11012024-12-06T02:41:14.789ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 159, 165]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11022024-12-06T02:41:14.789ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11032024-12-06T02:41:14.790ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11042024-12-06T02:41:14.790ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11052024-12-06T02:41:14.845ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 163, 53]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11062024-12-06T02:41:14.845ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11072024-12-06T02:41:14.846ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11082024-12-06T02:41:14.846ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11092024-12-06T02:41:14.897ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 150, 255]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11102024-12-06T02:41:14.897ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
11112024-12-06T02:41:14.900ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11122024-12-06T02:41:14.900ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11132024-12-06T02:41:14.952ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 238, 207]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11142024-12-06T02:41:14.952ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
11152024-12-06T02:41:14.952ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11162024-12-06T02:41:14.952ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11172024-12-06T02:41:14.954ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11182024-12-06T02:41:14.954ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11192024-12-06T02:41:15.005ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 164, 1]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11202024-12-06T02:41:15.005ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11212024-12-06T02:41:15.006ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11222024-12-06T02:41:15.006ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11232024-12-06T02:41:15.006ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11242024-12-06T02:41:15.006ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11252024-12-06T02:41:15.006ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11262024-12-06T02:41:15.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11272024-12-06T02:41:15.007ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11282024-12-06T02:41:15.009ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11292024-12-06T02:41:15.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11302024-12-06T02:41:15.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11312024-12-06T02:41:15.166ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11322024-12-06T02:41:15.166ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11332024-12-06T02:41:15.166ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda file = illumos-utils/src/zone.rs:325
11342024-12-06T02:41:15.182ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11352024-12-06T02:41:15.182ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11362024-12-06T02:41:15.182ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25 file = illumos-utils/src/zone.rs:325
11372024-12-06T02:41:15.196ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e file = illumos-utils/src/zone.rs:325
11382024-12-06T02:41:15.212ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11392024-12-06T02:41:15.214ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda file = illumos-utils/src/zone.rs:363
11402024-12-06T02:41:15.229ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11412024-12-06T02:41:15.232ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11422024-12-06T02:41:15.232ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11432024-12-06T02:41:15.233ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25 file = illumos-utils/src/zone.rs:363
11442024-12-06T02:41:15.244ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e file = illumos-utils/src/zone.rs:363
11452024-12-06T02:41:15.349ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d file = illumos-utils/src/zone.rs:325
11462024-12-06T02:41:15.372ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8 file = illumos-utils/src/zone.rs:325
11472024-12-06T02:41:15.389ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d file = illumos-utils/src/zone.rs:363
11482024-12-06T02:41:15.412ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8 file = illumos-utils/src/zone.rs:363
11492024-12-06T02:41:17.128ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a53e1dba-95c6-499d-993b-9db7935a1bcf'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11502024-12-06T02:41:17.128ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
11512024-12-06T02:41:17.137ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='12e92244-2399-4dc5-ba2a-661965473670'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11522024-12-06T02:41:17.137ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3215e18d-10da-4248-a0ac-1e11521027d3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1c7841dc-e4ce-4fb3-b35b-f90685007f44'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11532024-12-06T02:41:17.137ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ed0f6b4c-a263-4943-a9b8-a6a13ac62fd1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11542024-12-06T02:41:17.138ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='55fc7aec-acb8-4503-b992-6a7381b41217'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11552024-12-06T02:41:17.138ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
11562024-12-06T02:41:17.145ZINFOSledAgent (ServiceManager): Booting oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
11572024-12-06T02:41:17.151ZINFOSledAgent (ServiceManager): Booting oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
11582024-12-06T02:41:17.158ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
11592024-12-06T02:41:17.185ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e5198117-905c-4bd4-a346-8bb8bbca49c5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11602024-12-06T02:41:17.185ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
11612024-12-06T02:41:17.491ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='a3056c3a-712e-4eef-91fb-ab53fb7138ad'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11622024-12-06T02:41:17.492ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
11632024-12-06T02:41:17.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 59.574388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
11642024-12-06T02:41:17.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 45.681941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
11652024-12-06T02:41:17.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 41.481015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
11662024-12-06T02:41:17.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 59.531676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
11672024-12-06T02:41:17.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 60.852482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
11682024-12-06T02:41:17.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 43.157763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
11692024-12-06T02:41:17.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 113.983535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
11702024-12-06T02:41:17.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 55.704236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
11712024-12-06T02:41:17.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 72.852842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
11722024-12-06T02:41:25.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 290.958514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
11732024-12-06T02:41:26.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 156.347448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
11742024-12-06T02:41:26.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 138.479665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
11752024-12-06T02:41:26.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 96.809132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
11762024-12-06T02:41:26.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 65.08876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
11772024-12-06T02:41:26.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 125.259296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
11782024-12-06T02:41:26.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 312.147447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
11792024-12-06T02:41:26.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 257.921064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
11802024-12-06T02:41:26.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 36.60059ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
11812024-12-06T02:41:26.840ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='407d7f74-f722-4bc1-8c98-93b96ceb8c76'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11822024-12-06T02:41:26.841ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2e1578fd-7835-4cef-bc2c-ab571a943504/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0ad2fec2-db44-42f9-9598-3e9a4ebf3a75'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11832024-12-06T02:41:26.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 255.172954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
11842024-12-06T02:41:26.856ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11852024-12-06T02:41:26.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 134.12361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
11862024-12-06T02:41:26.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 187.266106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
11872024-12-06T02:41:26.882ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11882024-12-06T02:41:26.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 72.367128ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
11892024-12-06T02:41:26.894ZINFOSledAgent (ServiceManager): Booting oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
11902024-12-06T02:41:26.902ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
11912024-12-06T02:41:26.909ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
11922024-12-06T02:41:26.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 214.039056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
11932024-12-06T02:41:26.927ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
11942024-12-06T02:41:26.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 149.779961ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
11952024-12-06T02:41:27.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 272.970115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
11962024-12-06T02:41:27.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 204.174273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
11972024-12-06T02:41:27.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 1.087426437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
11982024-12-06T02:41:27.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 529.184123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
11992024-12-06T02:41:27.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 518.206874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
12002024-12-06T02:41:27.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 453.763786ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
12012024-12-06T02:41:27.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 309.13443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
12022024-12-06T02:41:27.234ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12032024-12-06T02:41:27.234ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
12042024-12-06T02:41:27.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 29.405551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
12052024-12-06T02:41:27.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 43.072665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
12062024-12-06T02:41:27.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 63.954104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
12072024-12-06T02:41:27.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 60.711468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
12082024-12-06T02:41:27.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 465.472141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
12092024-12-06T02:41:27.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 114.337595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
12102024-12-06T02:41:27.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 778.770316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
12112024-12-06T02:41:27.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 55.076608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
12122024-12-06T02:41:27.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 124.628955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
12132024-12-06T02:41:27.382ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2770546e-59fa-4ec3-8490-b551f4075d06/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='89e5ccda-e8d8-4732-a074-e66e96edef25'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12142024-12-06T02:41:27.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 104.386943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
12152024-12-06T02:41:27.393ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
12162024-12-06T02:41:27.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 188.774762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
12172024-12-06T02:41:27.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 189.416933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
12182024-12-06T02:41:27.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 56.002284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
12192024-12-06T02:41:27.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 742.230653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
12202024-12-06T02:41:27.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 244.842298ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
12212024-12-06T02:41:27.520ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12222024-12-06T02:41:27.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 173.372475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
12232024-12-06T02:41:27.543ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
12242024-12-06T02:41:27.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 130.022895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
12252024-12-06T02:41:27.567ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12262024-12-06T02:41:27.567ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
12272024-12-06T02:41:27.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 403.23093ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
12282024-12-06T02:41:27.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 579.464038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
12292024-12-06T02:41:27.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 318.009418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
12302024-12-06T02:41:27.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 670.871421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
12312024-12-06T02:41:27.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 1.399297369s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
12322024-12-06T02:41:27.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 285.438046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
12332024-12-06T02:41:27.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 61.699933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
12342024-12-06T02:41:27.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 393.463072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
12352024-12-06T02:41:27.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 292.833886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
12362024-12-06T02:41:27.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 71.221216ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
12372024-12-06T02:41:27.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 51.382741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
12382024-12-06T02:41:27.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 40.020465ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
12392024-12-06T02:41:27.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.056939358s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
12402024-12-06T02:41:27.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 106.198972ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
12412024-12-06T02:41:27.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 131.180484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
12422024-12-06T02:41:27.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 116.669887ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
12432024-12-06T02:41:27.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 245.046808ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
12442024-12-06T02:41:28.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 920.988008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
12452024-12-06T02:41:28.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 231.177931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
12462024-12-06T02:41:28.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 168.324398ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
12472024-12-06T02:41:28.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 402.077874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
12482024-12-06T02:41:28.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 1.03084135s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
12492024-12-06T02:41:28.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 492.014672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
12502024-12-06T02:41:28.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 930.080896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
12512024-12-06T02:41:28.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 434.689992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
12522024-12-06T02:41:28.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 977.682429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
12532024-12-06T02:41:28.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 323.929086ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
12542024-12-06T02:41:28.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 431.112841ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
12552024-12-06T02:41:28.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 589.363133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
12562024-12-06T02:41:28.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 692.134334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
12572024-12-06T02:41:28.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 769.009025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
12582024-12-06T02:41:28.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.29388455s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
12592024-12-06T02:41:28.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 406.509671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
12602024-12-06T02:41:28.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 929.718878ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
12612024-12-06T02:41:28.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 1.143844015s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
12622024-12-06T02:41:28.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 682.278337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
12632024-12-06T02:41:29.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 720.296239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
12642024-12-06T02:41:29.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.042111736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
12652024-12-06T02:41:29.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 1.438382384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
12662024-12-06T02:41:29.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 914.123938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
12672024-12-06T02:41:29.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 684.921806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
12682024-12-06T02:41:29.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 573.628969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
12692024-12-06T02:41:29.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 955.1412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
12702024-12-06T02:41:29.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 1.021025004s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
12712024-12-06T02:41:29.344ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.009215093s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
12722024-12-06T02:41:29.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 1.266622486s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
12732024-12-06T02:41:29.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 1.013194552s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
12742024-12-06T02:41:29.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 1.372564734s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
12752024-12-06T02:41:29.373ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12762024-12-06T02:41:29.373ZINFOSledAgent (ServiceManager): Booting oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
12772024-12-06T02:41:29.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 74.035237ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
12782024-12-06T02:41:29.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 927.463113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
12792024-12-06T02:41:29.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 83.593045ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
12802024-12-06T02:41:29.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 987.496394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
12812024-12-06T02:41:29.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 1.078321875s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
12822024-12-06T02:41:29.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 258.202315ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
12832024-12-06T02:41:29.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.155787819s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
12842024-12-06T02:41:29.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 710.334682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
12852024-12-06T02:41:29.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.160326914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
12862024-12-06T02:41:30.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 728.624958ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
12872024-12-06T02:41:30.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 213.680302ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
12882024-12-06T02:41:30.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.393038951s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
12892024-12-06T02:41:30.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.184041114s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
12902024-12-06T02:41:30.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 778.519454ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
12912024-12-06T02:41:30.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 1.073832733s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
12922024-12-06T02:41:30.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 1.136237558s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
12932024-12-06T02:41:30.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 1.396435729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
12942024-12-06T02:41:30.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 853.777036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
12952024-12-06T02:41:30.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 841.736286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
12962024-12-06T02:41:30.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 1.082164652s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
12972024-12-06T02:41:30.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 690.806997ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
12982024-12-06T02:41:30.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 991.988306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
12992024-12-06T02:41:30.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 1.195104552s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
13002024-12-06T02:41:30.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 1.454076846s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
13012024-12-06T02:41:30.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 813.013331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
13022024-12-06T02:41:30.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 543.321073ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
13032024-12-06T02:41:31.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 766.184016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
13042024-12-06T02:41:31.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 917.612429ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
13052024-12-06T02:41:31.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 995.132938ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
13062024-12-06T02:41:31.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 644.488501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
13072024-12-06T02:41:31.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 1.20220583s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
13082024-12-06T02:41:31.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 828.979942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
13092024-12-06T02:41:31.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 593.32576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
13102024-12-06T02:41:31.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.427442785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
13112024-12-06T02:41:31.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.143841445s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
13122024-12-06T02:41:31.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 1.153167823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
13132024-12-06T02:41:31.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 1.27785509s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
13142024-12-06T02:41:31.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 693.23359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
13152024-12-06T02:41:31.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.210032066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
13162024-12-06T02:41:31.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 781.139107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
13172024-12-06T02:41:31.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 740.573759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
13182024-12-06T02:41:31.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 1.445780472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
13192024-12-06T02:41:31.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 889.91021ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
13202024-12-06T02:41:32.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 783.359836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
13212024-12-06T02:41:32.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 599.046967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
13222024-12-06T02:41:32.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 1.48887947s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
13232024-12-06T02:41:32.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 1.469122252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
13242024-12-06T02:41:32.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 966.655277ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
13252024-12-06T02:41:32.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 1.373477803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
13262024-12-06T02:41:32.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 1.074433252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
13272024-12-06T02:41:32.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 817.501734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
13282024-12-06T02:41:32.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 853.530705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
13292024-12-06T02:41:32.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 818.402475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
13302024-12-06T02:41:32.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.314323107s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
13312024-12-06T02:41:32.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 1.409120938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
13322024-12-06T02:41:32.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.341503678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
13332024-12-06T02:41:32.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 1.307093687s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
13342024-12-06T02:41:32.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.128914668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
13352024-12-06T02:41:32.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.261733234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
13362024-12-06T02:41:32.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 779.522322ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
13372024-12-06T02:41:33.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 828.113368ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
13382024-12-06T02:41:33.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 891.201652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
13392024-12-06T02:41:33.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 1.452054789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
13402024-12-06T02:41:33.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 1.133983084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
13412024-12-06T02:41:33.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.486288093s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
13422024-12-06T02:41:33.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 629.128483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
13432024-12-06T02:41:33.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 781.573443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
13442024-12-06T02:41:33.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 679.470187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
13452024-12-06T02:41:33.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 737.723838ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
13462024-12-06T02:41:33.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 520.728857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
13472024-12-06T02:41:33.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 756.6984ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
13482024-12-06T02:41:34.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.299830472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
13492024-12-06T02:41:34.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 758.868814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
13502024-12-06T02:41:34.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 525.560714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
13512024-12-06T02:41:34.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 1.470527955s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
13522024-12-06T02:41:34.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.120073739s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
13532024-12-06T02:41:34.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 556.826402ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
13542024-12-06T02:41:34.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 739.783208ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
13552024-12-06T02:41:34.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 1.320382647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
13562024-12-06T02:41:34.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 1.114230373s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
13572024-12-06T02:41:34.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 1.1193894s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
13582024-12-06T02:41:34.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 1.451274271s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
13592024-12-06T02:41:34.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 1.302997991s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
13602024-12-06T02:41:34.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 1.109892704s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
13612024-12-06T02:41:34.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 621.292383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
13622024-12-06T02:41:34.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 659.590407ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
13632024-12-06T02:41:34.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 1.451281935s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
13642024-12-06T02:41:34.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 707.768373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
13652024-12-06T02:41:34.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.293569161s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
13662024-12-06T02:41:34.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 510.433197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
13672024-12-06T02:41:35.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 654.41893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
13682024-12-06T02:41:35.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 786.601861ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
13692024-12-06T02:41:35.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 861.366411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
13702024-12-06T02:41:35.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 890.033399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
13712024-12-06T02:41:35.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.036470177s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
13722024-12-06T02:41:35.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 1.214873106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
13732024-12-06T02:41:35.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.038925852s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
13742024-12-06T02:41:35.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 972.400447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
13752024-12-06T02:41:35.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 622.640016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
13762024-12-06T02:41:35.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 962.911543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
13772024-12-06T02:41:35.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 1.31193408s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
13782024-12-06T02:41:35.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 1.324660003s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
13792024-12-06T02:41:35.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 692.511351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
13802024-12-06T02:41:35.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 1.05687179s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
13812024-12-06T02:41:35.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 859.346095ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
13822024-12-06T02:41:36.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 954.17715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
13832024-12-06T02:41:36.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 993.50106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
13842024-12-06T02:41:36.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.214273234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
13852024-12-06T02:41:36.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 777.971499ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
13862024-12-06T02:41:36.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 868.298645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
13872024-12-06T02:41:36.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.348755346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
13882024-12-06T02:41:36.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 1.12013662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
13892024-12-06T02:41:36.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.476284711s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
13902024-12-06T02:41:36.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 766.898189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
13912024-12-06T02:41:36.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 720.580899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
13922024-12-06T02:41:36.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 936.092695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
13932024-12-06T02:41:36.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 1.218791176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
13942024-12-06T02:41:36.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 1.042174066s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
13952024-12-06T02:41:36.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 907.872544ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
13962024-12-06T02:41:36.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 549.105739ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
13972024-12-06T02:41:37.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 762.760112ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
13982024-12-06T02:41:37.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 1.341952622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
13992024-12-06T02:41:37.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 1.237538235s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
14002024-12-06T02:41:37.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 534.55083ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
14012024-12-06T02:41:37.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 800.923961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
14022024-12-06T02:41:37.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.056434686s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
14032024-12-06T02:41:37.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 1.341357811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
14042024-12-06T02:41:37.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 542.703627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
14052024-12-06T02:41:37.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 525.822218ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
14062024-12-06T02:41:37.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 1.079014635s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
14072024-12-06T02:41:37.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 1.408338727s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
14082024-12-06T02:41:37.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.256312573s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
14092024-12-06T02:41:37.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 1.113236199s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
14102024-12-06T02:41:37.784ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14112024-12-06T02:41:37.784ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
14122024-12-06T02:41:37.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 607.684777ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
14132024-12-06T02:41:37.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 1.127048345s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
14142024-12-06T02:41:37.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 1.052995286s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
14152024-12-06T02:41:37.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 952.145793ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
14162024-12-06T02:41:37.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.233001727s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
14172024-12-06T02:41:37.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.405293587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
14182024-12-06T02:41:38.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.283147088s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
14192024-12-06T02:41:38.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 34.331313ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
14202024-12-06T02:41:38.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 569.395794ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
14212024-12-06T02:41:38.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 124.677877ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
14222024-12-06T02:41:38.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 195.128528ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
14232024-12-06T02:41:38.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 989.234862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
14242024-12-06T02:41:38.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 749.741972ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
14252024-12-06T02:41:38.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 1.374145641s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
14262024-12-06T02:41:38.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 452.498521ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
14272024-12-06T02:41:38.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 827.378636ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
14282024-12-06T02:41:38.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 835.130602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
14292024-12-06T02:41:38.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 671.776241ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
14302024-12-06T02:41:38.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 1.446262353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
14312024-12-06T02:41:38.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 533.937383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
14322024-12-06T02:41:38.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 896.705303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
14332024-12-06T02:41:38.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.175151997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
14342024-12-06T02:41:38.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 897.860015ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
14352024-12-06T02:41:38.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 799.629875ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
14362024-12-06T02:41:38.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 1.239823627s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
14372024-12-06T02:41:38.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 870.975731ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
14382024-12-06T02:41:39.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.225593909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
14392024-12-06T02:41:39.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.309844849s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
14402024-12-06T02:41:39.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 553.43458ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
14412024-12-06T02:41:39.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.087947746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
14422024-12-06T02:41:39.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 1.416573335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
14432024-12-06T02:41:39.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 959.521808ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
14442024-12-06T02:41:39.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 568.940145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
14452024-12-06T02:41:39.396ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14462024-12-06T02:41:39.396ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
14472024-12-06T02:41:39.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.42076891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
14482024-12-06T02:41:39.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 1.397570841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
14492024-12-06T02:41:39.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 36.459545ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
14502024-12-06T02:41:39.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 114.761377ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
14512024-12-06T02:41:39.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 236.009113ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
14522024-12-06T02:41:39.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 645.827628ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
14532024-12-06T02:41:39.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 1.088449234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
14542024-12-06T02:41:39.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 684.835241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
14552024-12-06T02:41:39.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 549.224101ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
14562024-12-06T02:41:39.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 873.104518ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
14572024-12-06T02:41:39.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 531.10963ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
14582024-12-06T02:41:39.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 1.3683415s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
14592024-12-06T02:41:39.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 319.623075ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
14602024-12-06T02:41:40.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.316460009s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
14612024-12-06T02:41:40.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 860.912992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
14622024-12-06T02:41:40.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 895.250077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
14632024-12-06T02:41:40.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 1.003255209s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
14642024-12-06T02:41:40.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 1.27091041s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
14652024-12-06T02:41:40.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 711.566702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
14662024-12-06T02:41:40.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 1.078032997s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
14672024-12-06T02:41:40.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 562.685814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
14682024-12-06T02:41:40.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 593.547993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
14692024-12-06T02:41:40.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 821.011805ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
14702024-12-06T02:41:40.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 716.67664ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
14712024-12-06T02:41:40.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.36361166s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
14722024-12-06T02:41:40.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 735.29193ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
14732024-12-06T02:41:40.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 924.063785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
14742024-12-06T02:41:40.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.303545086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
14752024-12-06T02:41:40.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 578.157424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
14762024-12-06T02:41:40.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 659.841108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
14772024-12-06T02:41:40.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 846.542267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
14782024-12-06T02:41:40.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 628.311884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
14792024-12-06T02:41:41.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.389757707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
14802024-12-06T02:41:41.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.283648334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
14812024-12-06T02:41:41.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 685.717856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
14822024-12-06T02:41:41.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 574.896423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
14832024-12-06T02:41:41.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 803.887009ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
14842024-12-06T02:41:41.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 1.090186354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
14852024-12-06T02:41:41.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 647.174399ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
14862024-12-06T02:41:41.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.319956243s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
14872024-12-06T02:41:41.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 710.989253ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
14882024-12-06T02:41:41.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 679.863612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
14892024-12-06T02:41:41.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 916.03508ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
14902024-12-06T02:41:41.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 844.369578ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
14912024-12-06T02:41:41.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 847.614624ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
14922024-12-06T02:41:41.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 1.212638854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
14932024-12-06T02:41:41.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 1.017843844s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
14942024-12-06T02:41:41.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 887.989502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
14952024-12-06T02:41:41.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 1.442902546s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
14962024-12-06T02:41:41.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 774.431568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
14972024-12-06T02:41:41.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.373501554s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
14982024-12-06T02:41:41.953ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14992024-12-06T02:41:41.953ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
15002024-12-06T02:41:41.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 795.451873ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
15012024-12-06T02:41:42.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 840.711678ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
15022024-12-06T02:41:42.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 721.324538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
15032024-12-06T02:41:42.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 30.34469ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
15042024-12-06T02:41:42.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 581.673187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
15052024-12-06T02:41:42.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 1.113608853s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
15062024-12-06T02:41:42.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 93.757608ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
15072024-12-06T02:41:42.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 139.397678ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
15082024-12-06T02:41:42.338ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44717
15092024-12-06T02:41:42.340ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44717 req_id = 248da2ea-4aad-4180-a2dd-62fbe9da73a7 response_code = 200 uri = /baseboard
15102024-12-06T02:41:42.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 739.86618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
15112024-12-06T02:41:42.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 647.279517ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
15122024-12-06T02:41:42.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.102437982s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
15132024-12-06T02:41:42.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 714.803715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
15142024-12-06T02:41:42.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 927.875391ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
15152024-12-06T02:41:42.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 1.497586641s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
15162024-12-06T02:41:42.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 501.662936ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
15172024-12-06T02:41:42.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 1.197097042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
15182024-12-06T02:41:42.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 1.327436455s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
15192024-12-06T02:41:42.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 939.517425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
15202024-12-06T02:41:42.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 570.877304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
15212024-12-06T02:41:42.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 931.286303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
15222024-12-06T02:41:42.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 892.657866ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
15232024-12-06T02:41:42.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 919.323699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
15242024-12-06T02:41:42.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 1.070966065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
15252024-12-06T02:41:42.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 506.791431ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
15262024-12-06T02:41:42.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 706.164715ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
15272024-12-06T02:41:43.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 901.430572ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
15282024-12-06T02:41:43.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.243084834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
15292024-12-06T02:41:43.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 1.38423125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
15302024-12-06T02:41:43.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 1.059651023s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
15312024-12-06T02:41:43.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.453807113s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
15322024-12-06T02:41:43.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 592.601652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
15332024-12-06T02:41:43.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 1.307772831s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
15342024-12-06T02:41:43.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 543.670866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
15352024-12-06T02:41:43.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 1.184056214s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
15362024-12-06T02:41:43.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.404554865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
15372024-12-06T02:41:43.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 527.307086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
15382024-12-06T02:41:43.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 1.366956939s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
15392024-12-06T02:41:43.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 795.76107ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
15402024-12-06T02:41:43.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 951.010655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
15412024-12-06T02:41:43.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 858.47044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
15422024-12-06T02:41:43.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 599.142258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
15432024-12-06T02:41:43.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 982.606142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
15442024-12-06T02:41:43.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 814.04746ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
15452024-12-06T02:41:43.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 1.183112447s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
15462024-12-06T02:41:43.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 1.241992553s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
15472024-12-06T02:41:43.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 668.627628ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
15482024-12-06T02:41:44.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 964.718983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
15492024-12-06T02:41:44.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.03122657s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
15502024-12-06T02:41:44.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 1.077680462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
15512024-12-06T02:41:44.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.439537365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
15522024-12-06T02:41:44.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 1.139923156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
15532024-12-06T02:41:44.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 1.415600558s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
15542024-12-06T02:41:44.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 1.201499494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
15552024-12-06T02:41:44.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 714.282731ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
15562024-12-06T02:41:44.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 1.127255676s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
15572024-12-06T02:41:44.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 1.414236762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
15582024-12-06T02:41:44.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 891.475254ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
15592024-12-06T02:41:44.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.015356065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
15602024-12-06T02:41:44.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.162669195s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
15612024-12-06T02:41:44.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 1.040217275s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
15622024-12-06T02:41:44.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 1.151906492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
15632024-12-06T02:41:44.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.281509799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
15642024-12-06T02:41:45.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 818.274709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
15652024-12-06T02:41:45.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 816.498723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
15662024-12-06T02:41:45.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 619.474799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
15672024-12-06T02:41:45.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 1.246368727s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
15682024-12-06T02:41:45.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 937.640405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
15692024-12-06T02:41:45.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 1.009814708s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
15702024-12-06T02:41:45.416ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.084790653s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
15712024-12-06T02:41:45.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 1.477936142s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
15722024-12-06T02:41:45.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 1.484370874s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
15732024-12-06T02:41:45.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 1.205527589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
15742024-12-06T02:41:45.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.482015741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
15752024-12-06T02:41:45.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 1.134110824s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
15762024-12-06T02:41:45.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 1.485847259s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
15772024-12-06T02:41:45.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 525.003577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
15782024-12-06T02:41:45.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.313034168s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
15792024-12-06T02:41:45.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 909.735042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
15802024-12-06T02:41:45.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 618.2225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
15812024-12-06T02:41:45.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 1.280809619s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
15822024-12-06T02:41:45.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.331673334s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
15832024-12-06T02:41:45.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 659.824987ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
15842024-12-06T02:41:46.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 804.230704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
15852024-12-06T02:41:46.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 930.631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
15862024-12-06T02:41:46.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.433376952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
15872024-12-06T02:41:46.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 553.37543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
15882024-12-06T02:41:46.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 902.538713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
15892024-12-06T02:41:46.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 1.354010771s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
15902024-12-06T02:41:46.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 1.278120297s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
15912024-12-06T02:41:46.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 708.563214ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
15922024-12-06T02:41:46.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 568.547317ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
15932024-12-06T02:41:46.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 1.355038718s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
15942024-12-06T02:41:46.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 1.189164592s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
15952024-12-06T02:41:46.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.470504155s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
15962024-12-06T02:41:46.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227") failed: Property not found. retry in 1.422969147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
15972024-12-06T02:41:46.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 984.840586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
15982024-12-06T02:41:46.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 806.276417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
15992024-12-06T02:41:47.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd") failed: Property not found. retry in 1.182556182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
16002024-12-06T02:41:47.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 557.25074ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
16012024-12-06T02:41:47.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 603.326704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
16022024-12-06T02:41:47.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 1.475643854s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
16032024-12-06T02:41:47.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 1.419770131s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
16042024-12-06T02:41:47.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 997.334439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
16052024-12-06T02:41:47.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 1.412069297s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
16062024-12-06T02:41:47.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 840.333336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
16072024-12-06T02:41:47.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.075463032s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
16082024-12-06T02:41:47.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 587.655237ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
16092024-12-06T02:41:47.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8") failed: Property not found. retry in 1.471028605s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
16102024-12-06T02:41:47.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81") failed: Property not found. retry in 1.16469053s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
16112024-12-06T02:41:47.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1") failed: Property not found. retry in 867.98766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
16122024-12-06T02:41:47.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25") failed: Property not found. retry in 1.251310998s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
16132024-12-06T02:41:47.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 782.510353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
16142024-12-06T02:41:47.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec") failed: Property not found. retry in 1.204530233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
16152024-12-06T02:41:47.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 1.359481525s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
16162024-12-06T02:41:47.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 1.006037906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
16172024-12-06T02:41:48.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 581.072292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
16182024-12-06T02:41:48.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae") failed: Property not found. retry in 789.752335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
16192024-12-06T02:41:48.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4") failed: Property not found. retry in 633.802945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
16202024-12-06T02:41:48.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 567.019135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
16212024-12-06T02:41:48.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113") failed: Property not found. retry in 1.308105998s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
16222024-12-06T02:41:48.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e") failed: Property not found. retry in 1.432625945s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
16232024-12-06T02:41:48.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea") failed: Property not found. retry in 1.458428682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
16242024-12-06T02:41:48.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8") failed: Property not found. retry in 1.078442891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
16252024-12-06T02:41:48.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad") failed: Property not found. retry in 908.034019ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
16262024-12-06T02:41:48.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 827.990695ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
16272024-12-06T02:41:48.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 797.647156ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
16282024-12-06T02:41:48.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a") failed: Property not found. retry in 1.269146125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
16292024-12-06T02:41:48.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526") failed: Property not found. retry in 653.904432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
16302024-12-06T02:41:49.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d") failed: Property not found. retry in 1.447289138s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
16312024-12-06T02:41:49.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 631.300857ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
16322024-12-06T02:41:49.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda") failed: Property not found. retry in 1.205662931s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
16332024-12-06T02:41:50.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290") failed: Property not found. retry in 1.075556012s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
16342024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_d021c8bc-ba6f-4e09-8223-e21d77f943d8
16352024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_40689173-b5ff-4c49-b401-2c6da404b113
16362024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_ccdba72d-cbe7-4787-90d4-d52d38927b25
16372024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a9466476-412a-455d-a52b-9e4ed2fa1227
16382024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_a3056c3a-712e-4eef-91fb-ab53fb7138ad
16392024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_91d36286-1f73-4c81-8334-148353b10bf1
16402024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_ce91f9d7-c7d1-4de8-a07c-f487d71f1526
16412024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_910f4385-61c7-47ed-9825-264cb34321ec
16422024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_8862fdaf-bee3-4548-a137-b8038fc2a53e
16432024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a2172227-b31a-44ad-8e86-01b1df448d3a
16442024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a7677aed-c870-4cbb-898e-35dbe1020cae
16452024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_978be6b7-c081-4ef5-81fb-d8f564b5837d
16462024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_da5e8b0f-29f2-458f-8bba-dcd5fad613fd
16472024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_c318d295-50ed-4662-8b85-b8c4ac4d4e81
16482024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_3943088e-6ce0-4ada-925c-494df92c0dda
16492024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_9da9ecff-1155-48cf-ab8c-84d23c860290
16502024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_acd10f4a-0273-47b8-ace5-7f14700186ea
16512024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_762bf459-2b8d-4eb7-9936-2711780f30c8
16522024-12-06T02:41:51.402ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b119f655-8e72-4930-bca9-26e8985a42c4
16532024-12-06T02:41:51.411ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16542024-12-06T02:41:51.414ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16552024-12-06T02:41:51.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39139059 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49061 req_id = 583a2177-7a65-4ff6-9ffc-83c7e0377407 response_code = 204 uri = /omicron-zones
16562024-12-06T02:41:51.430ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
16572024-12-06T02:41:51.660ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16582024-12-06T02:41:51.661ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:802
16592024-12-06T02:41:51.709ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
16602024-12-06T02:41:53.859ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16612024-12-06T02:41:53.861ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.790855898s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
16622024-12-06T02:41:54.006ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16632024-12-06T02:41:54.166ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16642024-12-06T02:41:54.339ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16652024-12-06T02:41:54.554ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16662024-12-06T02:41:54.668ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16672024-12-06T02:41:54.831ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16682024-12-06T02:41:55.246ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16692024-12-06T02:41:55.643ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16702024-12-06T02:41:56.125ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16712024-12-06T02:41:56.858ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16722024-12-06T02:41:57.560ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa39b2e1-03c3-48c1-8086-8e14b63b0d10/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16732024-12-06T02:41:58.844ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b823d772-9a87-4ed7-84f9-c7c6ff9a4fab", "content-length": "173", "date": "Fri, 06 Dec 2024 02:41:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"fa39b2e1-03c3-48c1-8086-8e14b63b0d10\"", request_id: "b823d772-9a87-4ed7-84f9-c7c6ff9a4fab" } file = sled-agent/src/rack_setup/service.rs:1078
16742024-12-06T02:42:01.174ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7a463958-14bc-4567-b5ff-9870e1288864", "content-length": "173", "date": "Fri, 06 Dec 2024 02:42:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5455a27f-b1dd-4d8d-adde-726221dabebe\"", request_id: "7a463958-14bc-4567-b5ff-9870e1288864" } file = sled-agent/src/rack_setup/service.rs:1078
16752024-12-06T02:42:02.709ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5ff5d302-db21-481a-a80d-8f7e638bf179", "content-length": "173", "date": "Fri, 06 Dec 2024 02:42:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5455a27f-b1dd-4d8d-adde-726221dabebe\"", request_id: "5ff5d302-db21-481a-a80d-8f7e638bf179" } file = sled-agent/src/rack_setup/service.rs:1078
16762024-12-06T02:42:04.150ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "36331d36-d717-4923-8fd2-c59dfadd034c", "content-length": "173", "date": "Fri, 06 Dec 2024 02:42:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5455a27f-b1dd-4d8d-adde-726221dabebe\"", request_id: "36331d36-d717-4923-8fd2-c59dfadd034c" } file = sled-agent/src/rack_setup/service.rs:1078
16772024-12-06T02:42:06.500ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9f9eeb0d-5673-424b-93ae-5f1c2e8800ca", "content-length": "173", "date": "Fri, 06 Dec 2024 02:42:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5455a27f-b1dd-4d8d-adde-726221dabebe\"", request_id: "9f9eeb0d-5673-424b-93ae-5f1c2e8800ca" } file = sled-agent/src/rack_setup/service.rs:1078
16782024-12-06T02:42:09.597ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "dad996a6-e2b7-4c49-a897-c4205b5626da", "content-length": "173", "date": "Fri, 06 Dec 2024 02:42:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5455a27f-b1dd-4d8d-adde-726221dabebe\"", request_id: "dad996a6-e2b7-4c49-a897-c4205b5626da" } file = sled-agent/src/rack_setup/service.rs:1078
16792024-12-06T02:42:12.379ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39147
16802024-12-06T02:42:12.379ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39147 req_id = 4aeee268-7c77-4353-acf1-8c455baf069d response_code = 200 uri = /baseboard
16812024-12-06T02:42:12.397ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6744c388-61c2-460b-b296-b6a7a765aecf", "content-length": "173", "date": "Fri, 06 Dec 2024 02:42:12 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5455a27f-b1dd-4d8d-adde-726221dabebe\"", request_id: "6744c388-61c2-460b-b296-b6a7a765aecf" } file = sled-agent/src/rack_setup/service.rs:1078
16822024-12-06T02:42:15.254ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:38591 remote_addr = [fd00:1122:3344:101::d]:59181 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
16832024-12-06T02:42:15.271ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16911 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 78a17e0e-5425-4eee-819a-37926d6a82e3 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
16842024-12-06T02:42:15.485ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6e878a4c-946a-4c4a-a21b-96370c3940da", "content-length": "173", "date": "Fri, 06 Dec 2024 02:42:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5455a27f-b1dd-4d8d-adde-726221dabebe\"", request_id: "6e878a4c-946a-4c4a-a21b-96370c3940da" } file = sled-agent/src/rack_setup/service.rs:1078
16852024-12-06T02:42:17.469ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "09d60c1f-7ec4-4777-a386-d374bb7acdb3", "content-length": "173", "date": "Fri, 06 Dec 2024 02:42:17 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5455a27f-b1dd-4d8d-adde-726221dabebe\"", request_id: "09d60c1f-7ec4-4777-a386-d374bb7acdb3" } file = sled-agent/src/rack_setup/service.rs:1078
16862024-12-06T02:42:21.212ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "075811f4-5f83-4ff5-906a-01ab87f99398", "content-length": "173", "date": "Fri, 06 Dec 2024 02:42:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5455a27f-b1dd-4d8d-adde-726221dabebe\"", request_id: "075811f4-5f83-4ff5-906a-01ab87f99398" } file = sled-agent/src/rack_setup/service.rs:1078
16872024-12-06T02:42:24.618ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "da463c7b-00af-4202-8ba3-5969fb8034c1", "content-length": "173", "date": "Fri, 06 Dec 2024 02:42:24 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5455a27f-b1dd-4d8d-adde-726221dabebe\"", request_id: "da463c7b-00af-4202-8ba3-5969fb8034c1" } file = sled-agent/src/rack_setup/service.rs:1078
16882024-12-06T02:42:27.156ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
16892024-12-06T02:42:27.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35721
16902024-12-06T02:42:27.470ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16912024-12-06T02:42:27.470ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16922024-12-06T02:42:27.471ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-zones.json file = common/src/ledger.rs:177
16932024-12-06T02:42:27.471ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-zones.json file = common/src/ledger.rs:177
16942024-12-06T02:42:27.483ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16952024-12-06T02:42:27.483ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2770546e-59fa-4ec3-8490-b551f4075d06
16962024-12-06T02:42:27.507ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16972024-12-06T02:42:27.507ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5
16982024-12-06T02:42:27.527ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16992024-12-06T02:42:27.527ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2
17002024-12-06T02:42:27.549ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17012024-12-06T02:42:27.549ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726
17022024-12-06T02:42:27.567ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17032024-12-06T02:42:27.568ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e1578fd-7835-4cef-bc2c-ab571a943504
17042024-12-06T02:42:27.588ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17052024-12-06T02:42:27.588ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb
17062024-12-06T02:42:27.607ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17072024-12-06T02:42:27.607ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3215e18d-10da-4248-a0ac-1e11521027d3
17082024-12-06T02:42:27.625ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17092024-12-06T02:42:27.625ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea
17102024-12-06T02:42:27.644ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17112024-12-06T02:42:27.644ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867
17122024-12-06T02:42:27.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184797 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35721 req_id = 0cb20815-97d9-48d2-88da-b563998704db response_code = 200 uri = /inventory
17132024-12-06T02:42:29.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39241
17142024-12-06T02:42:29.352ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17152024-12-06T02:42:29.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17162024-12-06T02:42:29.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17172024-12-06T02:42:29.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17182024-12-06T02:42:29.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17192024-12-06T02:42:29.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17202024-12-06T02:42:29.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17212024-12-06T02:42:29.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39241 req_id = f0253d66-7c22-4eb5-b574-48e4676214ca response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17222024-12-06T02:42:29.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41117
17232024-12-06T02:42:29.406ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17242024-12-06T02:42:29.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17252024-12-06T02:42:29.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17262024-12-06T02:42:29.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17272024-12-06T02:42:29.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17282024-12-06T02:42:29.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17292024-12-06T02:42:29.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17302024-12-06T02:42:29.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41117 req_id = 0d2088cd-7746-438b-802a-a96374b2b6f5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17312024-12-06T02:42:29.407ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
17322024-12-06T02:42:29.410ZINFOSledAgent (RSS): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17332024-12-06T02:42:29.411ZINFOSledAgent (RSS): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17342024-12-06T02:42:29.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45935
17352024-12-06T02:42:29.813ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17362024-12-06T02:42:29.813ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17372024-12-06T02:42:29.813ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-zones.json file = common/src/ledger.rs:177
17382024-12-06T02:42:29.814ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-zones.json file = common/src/ledger.rs:177
17392024-12-06T02:42:29.826ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17402024-12-06T02:42:29.826ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2770546e-59fa-4ec3-8490-b551f4075d06
17412024-12-06T02:42:29.850ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17422024-12-06T02:42:29.850ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5
17432024-12-06T02:42:29.875ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17442024-12-06T02:42:29.875ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2
17452024-12-06T02:42:29.895ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17462024-12-06T02:42:29.895ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726
17472024-12-06T02:42:29.917ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17482024-12-06T02:42:29.917ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e1578fd-7835-4cef-bc2c-ab571a943504
17492024-12-06T02:42:29.938ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17502024-12-06T02:42:29.938ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb
17512024-12-06T02:42:29.956ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17522024-12-06T02:42:29.956ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3215e18d-10da-4248-a0ac-1e11521027d3
17532024-12-06T02:42:29.976ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17542024-12-06T02:42:29.976ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea
17552024-12-06T02:42:29.994ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17562024-12-06T02:42:29.994ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867
17572024-12-06T02:42:30.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191801 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45935 req_id = 2f41adae-6448-4465-9261-fd11cc0a77ce response_code = 200 uri = /inventory
17582024-12-06T02:42:30.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47197
17592024-12-06T02:42:30.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47197 req_id = 93af9cdc-5b25-445f-861d-28a9c744882e response_code = 200 uri = /vpc-routes
17602024-12-06T02:42:30.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36834
17612024-12-06T02:42:30.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36834 req_id = 11937379-6008-4af8-84c6-575c278f6148 response_code = 200 uri = /vpc-routes
17622024-12-06T02:42:30.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47418
17632024-12-06T02:42:30.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47418 req_id = 816cbd88-708b-4abe-a88a-ca8ebc4c93f1 response_code = 200 uri = /vpc-routes
17642024-12-06T02:42:30.439ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
17652024-12-06T02:42:30.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 569 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47197 req_id = 7bb5f34e-8309-480b-9c51-b42705f4cd37 response_code = 204 uri = /eip-gateways
17662024-12-06T02:42:30.441ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
17672024-12-06T02:42:30.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36834 req_id = ba74700e-0036-493b-b0ad-f94ba695cad0 response_code = 204 uri = /eip-gateways
17682024-12-06T02:42:30.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51809
17692024-12-06T02:42:30.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 461 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51809 req_id = 25f4aa5e-c0be-41bb-ac31-139f7f24fc72 response_code = 200 uri = /v2p
17702024-12-06T02:42:30.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47123
17712024-12-06T02:42:30.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17722024-12-06T02:42:30.712ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17732024-12-06T02:42:30.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47123 req_id = 26229046-b295-47a1-bf89-5b90bae8b335 response_code = 204 uri = /switch-ports
17742024-12-06T02:42:30.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34045
17752024-12-06T02:42:30.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39233
17762024-12-06T02:42:30.779ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
17772024-12-06T02:42:30.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47418 req_id = 2e2e9b33-5fbc-4b2a-808a-f80731f11b00 response_code = 204 uri = /eip-gateways
17782024-12-06T02:42:30.779ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17792024-12-06T02:42:30.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6673 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39233 req_id = 9b01033d-a7e0-43ce-ac51-e1ca9aa9736e response_code = 200 uri = /v2p
17802024-12-06T02:42:30.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34819
17812024-12-06T02:42:30.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47123 req_id = 95a3ef37-29f5-4727-91ef-d729b7a59363 response_code = 200 uri = /network-bootstore-config
17822024-12-06T02:42:30.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34819 req_id = 2693ab5e-360b-4acc-bb2b-0b679b35071d response_code = 200 uri = /v2p
17832024-12-06T02:42:30.836ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17842024-12-06T02:42:30.836ZINFOSledAgent (bootstore): Writing ledger to /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17852024-12-06T02:42:30.838ZINFOSledAgent (bootstore): Writing ledger to /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17862024-12-06T02:42:30.840ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17872024-12-06T02:42:30.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47123 req_id = f3db0c3f-5803-4af9-92fe-3f79f4e51bfe response_code = 204 uri = /network-bootstore-config
17882024-12-06T02:42:30.840ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17892024-12-06T02:42:30.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36466
17902024-12-06T02:42:30.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47197 req_id = 16418359-bf6d-4f46-8df6-94934fa6a6ce response_code = 204 uri = /vpc-routes
17912024-12-06T02:42:30.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42916
17922024-12-06T02:42:30.913ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17932024-12-06T02:42:30.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17942024-12-06T02:42:30.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17952024-12-06T02:42:30.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17962024-12-06T02:42:30.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17972024-12-06T02:42:30.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17982024-12-06T02:42:30.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17992024-12-06T02:42:30.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 715 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42916 req_id = ec7402b6-8d75-46d0-b12c-e734fba3e73d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18002024-12-06T02:42:30.918ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
18012024-12-06T02:42:30.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47418 req_id = 814baad1-6825-4d31-b945-c4bfaba17249 response_code = 204 uri = /vpc-routes
18022024-12-06T02:42:30.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142367 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34045 req_id = 9bd7b377-799d-4700-b931-37fe1e50ef63 response_code = 204 uri = /switch-ports
18032024-12-06T02:42:30.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18042024-12-06T02:42:30.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 781 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34045 req_id = 10f34ad4-c00b-4155-9042-0e39316e8d62 response_code = 200 uri = /network-bootstore-config
18052024-12-06T02:42:30.965ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
18062024-12-06T02:42:30.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36834 req_id = 7576e2dc-e0ff-4e59-bb83-3a84b230f71d response_code = 204 uri = /vpc-routes
18072024-12-06T02:42:30.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18082024-12-06T02:42:31.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153312 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36466 req_id = f8b7c6c6-ff50-4210-9008-0e8bb57b3f43 response_code = 204 uri = /switch-ports
18092024-12-06T02:42:31.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36466 req_id = eade17c5-c3c2-4e2b-b402-5d315607fa37 response_code = 200 uri = /network-bootstore-config
18102024-12-06T02:42:31.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59817
18112024-12-06T02:42:31.126ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18122024-12-06T02:42:31.126ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18132024-12-06T02:42:31.126ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18142024-12-06T02:42:31.126ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18152024-12-06T02:42:31.126ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18162024-12-06T02:42:31.126ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18172024-12-06T02:42:31.126ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18182024-12-06T02:42:31.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59817 req_id = 9e720c49-7df2-427f-b04d-5e28ad965d7c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18192024-12-06T02:42:36.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53218
18202024-12-06T02:42:36.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53218 req_id = 604dba50-8ad6-4dcf-aa63-cdd7d7914148 response_code = 200 uri = /vpc-routes
18212024-12-06T02:42:37.079ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
18222024-12-06T02:42:37.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53218 req_id = 7cea95ff-f455-42f3-849b-b42552ac6cb1 response_code = 204 uri = /eip-gateways
18232024-12-06T02:42:37.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53218 req_id = 7f881e69-f000-4c4e-ae8d-47eb65d13671 response_code = 204 uri = /vpc-routes
18242024-12-06T02:42:42.414ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41550
18252024-12-06T02:42:42.415ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41550 req_id = 99597d03-d5a3-43b4-bd27-477bc8d37909 response_code = 200 uri = /baseboard
18262024-12-06T02:42:45.064ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7631 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = fcb7d5ed-8c4f-4aab-9087-be6c5d2b1082 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
18272024-12-06T02:43:00.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38077
18282024-12-06T02:43:00.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38077 req_id = 4719252c-d522-4af3-b588-58423c1d5a54 response_code = 200 uri = /vpc-routes
18292024-12-06T02:43:00.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60975
18302024-12-06T02:43:00.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60975 req_id = c27e52dd-5e37-41fd-9478-95d99547be0e response_code = 200 uri = /vpc-routes
18312024-12-06T02:43:00.497ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
18322024-12-06T02:43:00.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60975 req_id = eef78b50-8749-434d-b7ea-0fec03c2c9bf response_code = 204 uri = /eip-gateways
18332024-12-06T02:43:00.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50869
18342024-12-06T02:43:00.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50869 req_id = ea08b04a-8ea9-4116-9051-f855427df6cb response_code = 200 uri = /vpc-routes
18352024-12-06T02:43:00.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60975 req_id = e3985c5e-2c2f-4ed0-9502-4cf1f775db82 response_code = 204 uri = /vpc-routes
18362024-12-06T02:43:00.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59385
18372024-12-06T02:43:00.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59385 req_id = f14f1e2e-a025-4f53-b56b-5f57955b975e response_code = 200 uri = /v2p
18382024-12-06T02:43:00.595ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
18392024-12-06T02:43:00.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38077 req_id = afd55412-696b-404c-9a59-180a5a29de8f response_code = 204 uri = /eip-gateways
18402024-12-06T02:43:00.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39365
18412024-12-06T02:43:00.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39365 req_id = 391ca2fa-df82-4ca1-953d-42e0e0b494b3 response_code = 200 uri = /v2p
18422024-12-06T02:43:00.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38077 req_id = c81dc3b4-a762-4365-bdb9-a94bbdd347c4 response_code = 204 uri = /vpc-routes
18432024-12-06T02:43:00.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34174
18442024-12-06T02:43:00.629ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18452024-12-06T02:43:00.667ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18462024-12-06T02:43:00.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34174 req_id = 96c0c29f-6d47-44a4-84d4-e1964473922a response_code = 204 uri = /switch-ports
18472024-12-06T02:43:00.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58664
18482024-12-06T02:43:00.720ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
18492024-12-06T02:43:00.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50869 req_id = c3312576-d745-4fdb-bfe3-07457f2cb94b response_code = 204 uri = /eip-gateways
18502024-12-06T02:43:00.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64947
18512024-12-06T02:43:00.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44545
18522024-12-06T02:43:00.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34174 req_id = 228e255c-97c4-494e-b6b2-3854a4081bd5 response_code = 200 uri = /network-bootstore-config
18532024-12-06T02:43:00.720ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18542024-12-06T02:43:00.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58664 req_id = d82549ab-59d0-4120-a484-6eb6d5e4627b response_code = 200 uri = /v2p
18552024-12-06T02:43:00.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 406 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50869 req_id = 12e7e83e-7158-448e-b2f9-3fd81d66fbe3 response_code = 204 uri = /vpc-routes
18562024-12-06T02:43:00.755ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18572024-12-06T02:43:00.807ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18582024-12-06T02:43:00.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87385 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64947 req_id = 9112bb24-c457-4774-bbdd-af2be5ffdfd4 response_code = 204 uri = /switch-ports
18592024-12-06T02:43:00.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 707 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64947 req_id = 45aeab69-d253-4bdc-9073-fd944f80433f response_code = 200 uri = /network-bootstore-config
18602024-12-06T02:43:00.841ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18612024-12-06T02:43:00.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172236 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44545 req_id = 909e586a-5639-40aa-bf44-58c0c2c46b3d response_code = 204 uri = /switch-ports
18622024-12-06T02:43:00.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44545 req_id = eaf8a5b0-a15a-4f08-b7a4-5993ebc7ac31 response_code = 200 uri = /network-bootstore-config
18632024-12-06T02:43:12.448ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57277
18642024-12-06T02:43:12.449ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57277 req_id = c6c40b17-38d2-4c30-a5e7-1dc545cb6b29 response_code = 200 uri = /baseboard
18652024-12-06T02:43:15.044ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7191 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 7cbdf272-358d-420a-b48e-2f30d33cf7ed response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
18662024-12-06T02:43:30.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46992
18672024-12-06T02:43:30.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46992 req_id = c6c74146-a907-4f6f-be6d-5131ac0f270f response_code = 200 uri = /vpc-routes
18682024-12-06T02:43:30.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40023
18692024-12-06T02:43:30.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40023 req_id = 8b9ad302-d9f9-4de5-80eb-eefc610d38a7 response_code = 200 uri = /vpc-routes
18702024-12-06T02:43:30.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39747
18712024-12-06T02:43:30.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39747 req_id = bf3c4dd2-5c2a-4d94-91ed-55378835d2c9 response_code = 200 uri = /vpc-routes
18722024-12-06T02:43:30.418ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
18732024-12-06T02:43:30.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40023 req_id = a4bcb0c2-cd3f-4acd-ba3f-38871267ff7b response_code = 204 uri = /eip-gateways
18742024-12-06T02:43:30.473ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
18752024-12-06T02:43:30.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39747 req_id = 753ac57b-0358-460e-8f6a-fd820b5b65fa response_code = 204 uri = /eip-gateways
18762024-12-06T02:43:30.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52311
18772024-12-06T02:43:30.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52311 req_id = 8d6b106b-c6d8-48a4-a1ad-6fb63c69b64f response_code = 200 uri = /v2p
18782024-12-06T02:43:30.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39747 req_id = 7e12e3e5-5f55-4c3b-a09c-37c0e5e7926c response_code = 204 uri = /vpc-routes
18792024-12-06T02:43:30.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40023 req_id = f99687f7-79e5-4cf0-9a9d-41772c8527b0 response_code = 204 uri = /vpc-routes
18802024-12-06T02:43:30.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51932
18812024-12-06T02:43:30.496ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18822024-12-06T02:43:30.540ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18832024-12-06T02:43:30.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107691 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51932 req_id = cd54c5d3-b85a-418d-962d-4f458792f40e response_code = 204 uri = /switch-ports
18842024-12-06T02:43:30.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47318
18852024-12-06T02:43:30.604ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
18862024-12-06T02:43:30.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46992 req_id = bfb1a3ff-605c-4cd9-9d47-b4f4150118c3 response_code = 204 uri = /eip-gateways
18872024-12-06T02:43:30.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51648
18882024-12-06T02:43:30.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51932 req_id = facfd697-8b6a-4958-8ae3-729ecc67368d response_code = 200 uri = /network-bootstore-config
18892024-12-06T02:43:30.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47318 req_id = d3d1a4f0-a798-4a3d-926d-d87eed2aaa54 response_code = 200 uri = /v2p
18902024-12-06T02:43:30.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51648 req_id = 93879504-4289-4324-b88a-f9db6c5bcec0 response_code = 200 uri = /v2p
18912024-12-06T02:43:30.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46992 req_id = df87cb0d-8c10-4465-8770-2d22587e0ce0 response_code = 204 uri = /vpc-routes
18922024-12-06T02:43:30.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61081
18932024-12-06T02:43:30.623ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18942024-12-06T02:43:30.662ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18952024-12-06T02:43:30.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61081 req_id = 6a324c3c-2ba6-4c46-ad8f-5005c49c2000 response_code = 204 uri = /switch-ports
18962024-12-06T02:43:30.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38079
18972024-12-06T02:43:30.724ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18982024-12-06T02:43:30.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18992024-12-06T02:43:30.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94313 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38079 req_id = e21487b4-3089-4b3a-bcfc-3e7c5ca7de0b response_code = 204 uri = /switch-ports
19002024-12-06T02:43:30.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61081 req_id = 059d3622-67c4-47cb-9fc3-30f1e7657314 response_code = 200 uri = /network-bootstore-config
19012024-12-06T02:43:30.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38079 req_id = ba3dffb5-fb76-43fa-a3fd-aa02b67ee30b response_code = 200 uri = /network-bootstore-config
19022024-12-06T02:43:42.482ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54477
19032024-12-06T02:43:42.482ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54477 req_id = f78771a2-3cb9-4cef-a8fa-35ab0833ef8a response_code = 200 uri = /baseboard
19042024-12-06T02:43:45.041ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6848 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 1ed5b848-80ff-4998-a09a-27045c1df310 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
19052024-12-06T02:44:00.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34518
19062024-12-06T02:44:00.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34518 req_id = a46aee2e-fc75-4b36-8c2a-c40148f6aa0c response_code = 200 uri = /vpc-routes
19072024-12-06T02:44:00.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
19082024-12-06T02:44:00.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34518 req_id = e8f2259f-ee10-41aa-bb0b-400c7920aa7a response_code = 204 uri = /eip-gateways
19092024-12-06T02:44:00.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34518 req_id = 8fc4475d-5636-4817-8974-13e33c14236b response_code = 204 uri = /vpc-routes
19102024-12-06T02:44:00.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49714
19112024-12-06T02:44:00.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49714 req_id = cfb13ff3-f932-4168-acd5-b6b2a7d58e55 response_code = 200 uri = /v2p
19122024-12-06T02:44:00.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61362
19132024-12-06T02:44:00.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61362 req_id = a4517ca2-52e1-4866-95a3-18f001096ab1 response_code = 200 uri = /v2p
19142024-12-06T02:44:00.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56737
19152024-12-06T02:44:00.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56737 req_id = 13a5a4e5-db2f-4512-9d5e-df4572cd457b response_code = 200 uri = /vpc-routes
19162024-12-06T02:44:00.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57218
19172024-12-06T02:44:00.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57218 req_id = 0bfb51ab-d0de-4c77-8542-d5daef77dfc9 response_code = 200 uri = /v2p
19182024-12-06T02:44:00.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
19192024-12-06T02:44:00.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56737 req_id = e95f3ae1-c1e8-4f87-b4ce-4dc73083eb0b response_code = 204 uri = /eip-gateways
19202024-12-06T02:44:00.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56737 req_id = 6c0c6a21-5cc0-4385-b63b-2609044da29d response_code = 204 uri = /vpc-routes
19212024-12-06T02:44:00.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54235
19222024-12-06T02:44:00.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54235 req_id = 5664f5db-f456-4b27-a86d-a21ac4c4bbe0 response_code = 200 uri = /vpc-routes
19232024-12-06T02:44:00.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33571
19242024-12-06T02:44:00.732ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19252024-12-06T02:44:00.770ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19262024-12-06T02:44:00.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33571 req_id = 6f01f32d-7ee4-42f3-a421-c30ebb87f36a response_code = 204 uri = /switch-ports
19272024-12-06T02:44:00.824ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
19282024-12-06T02:44:00.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54235 req_id = 6abd2415-7595-4d0e-9a84-3b9bd5448f99 response_code = 204 uri = /eip-gateways
19292024-12-06T02:44:00.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33571 req_id = 0e06a7c9-84bd-40d5-9c15-d6bcbc8b2932 response_code = 200 uri = /network-bootstore-config
19302024-12-06T02:44:00.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51263
19312024-12-06T02:44:00.835ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19322024-12-06T02:44:00.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54235 req_id = 80ede912-a857-4283-a932-00bd580f9af7 response_code = 204 uri = /vpc-routes
19332024-12-06T02:44:00.871ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19342024-12-06T02:44:00.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57881
19352024-12-06T02:44:00.923ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19362024-12-06T02:44:00.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92620 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51263 req_id = 6dba5209-9b1a-479d-ba26-99a130773106 response_code = 204 uri = /switch-ports
19372024-12-06T02:44:00.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 569 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51263 req_id = 88e24c91-73dc-4ed0-b146-05c080af3469 response_code = 200 uri = /network-bootstore-config
19382024-12-06T02:44:00.956ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19392024-12-06T02:44:01.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57881 req_id = 3a5bd6b0-ab81-4fcb-bdd5-b5dca60b4eb6 response_code = 204 uri = /switch-ports
19402024-12-06T02:44:01.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57881 req_id = e8eda144-ee59-4bb9-bb3e-2d352ef4417a response_code = 200 uri = /network-bootstore-config
19412024-12-06T02:44:12.517ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40049
19422024-12-06T02:44:12.517ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40049 req_id = f9bfa7c8-d854-4354-ae74-6dcb01425160 response_code = 200 uri = /baseboard
19432024-12-06T02:44:15.041ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6902 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 577dcd90-d044-42db-ba1d-7a1db4c0408b response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
19442024-12-06T02:44:30.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34577
19452024-12-06T02:44:30.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34577 req_id = 88bbfe39-b449-4ade-97c0-b5c6f6b31de4 response_code = 200 uri = /vpc-routes
19462024-12-06T02:44:30.326ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
19472024-12-06T02:44:30.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34577 req_id = 6eef0a1a-ef1a-47c0-8b57-8c6626c0d9e0 response_code = 204 uri = /eip-gateways
19482024-12-06T02:44:30.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34577 req_id = 312ecc69-7f27-41d1-b050-97d2e6db08a8 response_code = 204 uri = /vpc-routes
19492024-12-06T02:44:30.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56928
19502024-12-06T02:44:30.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56928 req_id = 0dbbd223-d785-4eba-8a77-89e39a71856d response_code = 200 uri = /vpc-routes
19512024-12-06T02:44:30.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47852
19522024-12-06T02:44:30.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47852 req_id = 64e1c203-4546-4e7c-b74b-e6047cbd9432 response_code = 200 uri = /v2p
19532024-12-06T02:44:30.394ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
19542024-12-06T02:44:30.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56928 req_id = 00763c90-cb59-45c5-a5b4-243dfa126477 response_code = 204 uri = /eip-gateways
19552024-12-06T02:44:30.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35926
19562024-12-06T02:44:30.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35926 req_id = 1ff995cc-358f-4242-a0d5-9aff1235139b response_code = 200 uri = /v2p
19572024-12-06T02:44:30.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56928 req_id = 5a869af6-186d-43b7-a3b9-7e7b0d7dd84c response_code = 204 uri = /vpc-routes
19582024-12-06T02:44:30.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45597
19592024-12-06T02:44:30.482ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19602024-12-06T02:44:30.522ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19612024-12-06T02:44:30.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102476 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45597 req_id = cc65fd4a-a610-4b4f-be81-68aa476dcedc response_code = 204 uri = /switch-ports
19622024-12-06T02:44:30.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38769
19632024-12-06T02:44:30.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55563
19642024-12-06T02:44:30.588ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19652024-12-06T02:44:30.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36605
19662024-12-06T02:44:30.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45597 req_id = 3f468433-cfc5-4f26-96d0-b964eb18ca9e response_code = 200 uri = /network-bootstore-config
19672024-12-06T02:44:30.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55563 req_id = d8d32572-81be-4c44-904e-f0523f0106b1 response_code = 200 uri = /vpc-routes
19682024-12-06T02:44:30.626ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19692024-12-06T02:44:30.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63935
19702024-12-06T02:44:30.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63935 req_id = f3b14f16-05ed-44a5-a208-99b341b56a80 response_code = 200 uri = /v2p
19712024-12-06T02:44:30.641ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
19722024-12-06T02:44:30.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 527 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55563 req_id = 7aad1f30-1bed-48f8-a5c8-da5dfd1bf90d response_code = 204 uri = /eip-gateways
19732024-12-06T02:44:30.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 887 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55563 req_id = ac944536-7f8a-4448-8a73-f8bd98229f7f response_code = 204 uri = /vpc-routes
19742024-12-06T02:44:30.680ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19752024-12-06T02:44:30.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92691 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38769 req_id = dd122261-a068-44fa-99d1-7b399d661a6b response_code = 204 uri = /switch-ports
19762024-12-06T02:44:30.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 704 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38769 req_id = 6e11f983-ea2b-40bc-aaeb-5dcf637e453d response_code = 200 uri = /network-bootstore-config
19772024-12-06T02:44:30.717ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19782024-12-06T02:44:30.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179059 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36605 req_id = f1d9257d-4e54-43db-8b3d-d7fd50131296 response_code = 204 uri = /switch-ports
19792024-12-06T02:44:30.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36605 req_id = b9cd998f-0d5c-4cab-8208-54fbe5255dc7 response_code = 200 uri = /network-bootstore-config
19802024-12-06T02:44:42.551ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45001
19812024-12-06T02:44:42.551ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45001 req_id = 615665d4-831f-44ad-9252-51f3f9c5b630 response_code = 200 uri = /baseboard
19822024-12-06T02:44:45.044ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8868 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = d967645f-a54b-4945-ac62-ee5ef5727bf2 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
19832024-12-06T02:44:53.120ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19842024-12-06T02:45:00.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51139
19852024-12-06T02:45:00.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51139 req_id = ec3ec25e-2148-4cc2-9493-5392db4e9b9b response_code = 200 uri = /vpc-routes
19862024-12-06T02:45:00.364ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
19872024-12-06T02:45:00.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51139 req_id = f35e72a4-60bd-4498-ada5-a8d8c517325b response_code = 204 uri = /eip-gateways
19882024-12-06T02:45:00.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60120
19892024-12-06T02:45:00.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60120 req_id = 9d73f3d1-1ad3-4025-85b7-82a1ecf2d166 response_code = 200 uri = /vpc-routes
19902024-12-06T02:45:00.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36379
19912024-12-06T02:45:00.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36379 req_id = c9022790-da32-466a-b3f0-1ef3f3de75dd response_code = 200 uri = /v2p
19922024-12-06T02:45:00.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51139 req_id = c369274a-358e-4b7e-b27c-c404ee671b82 response_code = 204 uri = /vpc-routes
19932024-12-06T02:45:00.502ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
19942024-12-06T02:45:00.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60120 req_id = d66d8f4f-1ee6-487d-84b2-7299464ad32f response_code = 204 uri = /eip-gateways
19952024-12-06T02:45:00.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36686
19962024-12-06T02:45:00.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36686 req_id = a88227db-03e7-4f45-8335-ba3232f513b1 response_code = 200 uri = /vpc-routes
19972024-12-06T02:45:00.574ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
19982024-12-06T02:45:00.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36686 req_id = aeb45a1b-a50e-406e-890b-8dcd105da844 response_code = 204 uri = /eip-gateways
19992024-12-06T02:45:00.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53662
20002024-12-06T02:45:00.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53662 req_id = 8fa88ef1-ff10-47f0-9c8b-17535e3ff962 response_code = 200 uri = /v2p
20012024-12-06T02:45:00.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63335
20022024-12-06T02:45:00.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63335 req_id = 15560f2a-f178-4772-a38f-6f3353e63ce0 response_code = 200 uri = /v2p
20032024-12-06T02:45:00.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36686 req_id = 693f9f2a-305d-43a6-b28b-1032a7754704 response_code = 204 uri = /vpc-routes
20042024-12-06T02:45:00.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60120 req_id = 97569ee4-86d2-4c11-bc62-76653cba7ae1 response_code = 204 uri = /vpc-routes
20052024-12-06T02:45:00.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34461
20062024-12-06T02:45:00.664ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20072024-12-06T02:45:00.724ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20082024-12-06T02:45:00.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164308 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34461 req_id = 54cc37a4-e11c-48f4-99fa-9f1d63e98628 response_code = 204 uri = /switch-ports
20092024-12-06T02:45:00.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50273
20102024-12-06T02:45:00.828ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20112024-12-06T02:45:00.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20122024-12-06T02:45:01.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185529 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50273 req_id = 92c38715-3632-41a5-9025-ba4a909c63bc response_code = 204 uri = /switch-ports
20132024-12-06T02:45:01.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62103
20142024-12-06T02:45:01.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34461 req_id = cb65da66-8760-4406-8970-42c5d51233fb response_code = 200 uri = /network-bootstore-config
20152024-12-06T02:45:01.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50273 req_id = bef5de49-8caa-4e7c-8cd6-4517847cc1bb response_code = 200 uri = /network-bootstore-config
20162024-12-06T02:45:01.014ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20172024-12-06T02:45:01.065ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20182024-12-06T02:45:01.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154245 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62103 req_id = 20dc9968-2cb4-4f68-b64a-1be0fc13d7eb response_code = 204 uri = /switch-ports
20192024-12-06T02:45:01.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62103 req_id = 447f38d7-a617-49bc-9e84-b846aca82272 response_code = 200 uri = /network-bootstore-config
20202024-12-06T02:45:12.584ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63663
20212024-12-06T02:45:12.584ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63663 req_id = e28adca1-ba7f-4e5a-b24e-a297e0a4b39c response_code = 200 uri = /baseboard
20222024-12-06T02:45:15.041ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7239 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 2e23c7cf-4593-41ca-bd63-ecaaa8998e87 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
20232024-12-06T02:45:30.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56881
20242024-12-06T02:45:30.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56881 req_id = cd27f1a7-122d-4306-8366-ceb2404f3f1b response_code = 200 uri = /vpc-routes
20252024-12-06T02:45:30.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40077
20262024-12-06T02:45:30.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40077 req_id = ac297483-e5c1-4ac7-941d-93768da70f92 response_code = 200 uri = /vpc-routes
20272024-12-06T02:45:30.434ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
20282024-12-06T02:45:30.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40077 req_id = e5eda09f-f85b-4510-b33a-97c8393d58fa response_code = 204 uri = /eip-gateways
20292024-12-06T02:45:30.446ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
20302024-12-06T02:45:30.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56881 req_id = b8d79787-898f-4526-ba3b-d1da0a03cf15 response_code = 204 uri = /eip-gateways
20312024-12-06T02:45:30.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37136
20322024-12-06T02:45:30.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37136 req_id = b1ad9156-d0d4-4c2b-be70-ab9cb05a3bb9 response_code = 200 uri = /v2p
20332024-12-06T02:45:30.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58428
20342024-12-06T02:45:30.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58428 req_id = a589c16f-2dc9-480e-b08e-8d6b9dc986ac response_code = 200 uri = /vpc-routes
20352024-12-06T02:45:30.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56056
20362024-12-06T02:45:30.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56056 req_id = 99b0d56b-7c04-4a13-9fed-7d04bc8a18c1 response_code = 200 uri = /v2p
20372024-12-06T02:45:30.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49822
20382024-12-06T02:45:30.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49822 req_id = 3375099b-9499-4ad3-a31c-8c2bc7592596 response_code = 200 uri = /v2p
20392024-12-06T02:45:30.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58408
20402024-12-06T02:45:30.498ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20412024-12-06T02:45:30.538ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20422024-12-06T02:45:30.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99511 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58408 req_id = c3628308-82b6-4574-b512-0d57f9067b65 response_code = 204 uri = /switch-ports
20432024-12-06T02:45:30.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37277
20442024-12-06T02:45:30.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50078
20452024-12-06T02:45:30.598ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
20462024-12-06T02:45:30.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 605 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56881 req_id = 25baac9a-3b50-403b-b91f-be4224b2f1e1 response_code = 204 uri = /vpc-routes
20472024-12-06T02:45:30.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58428 req_id = bc0a6f58-81f8-42ae-ab26-286d3253bb1a response_code = 204 uri = /eip-gateways
20482024-12-06T02:45:30.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58408 req_id = a6d24923-ea66-45cc-9cb9-788666ccf4dd response_code = 200 uri = /network-bootstore-config
20492024-12-06T02:45:30.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20502024-12-06T02:45:30.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3703 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40077 req_id = 5dabc4cf-7d0b-49d0-a0bd-de14395cab85 response_code = 204 uri = /vpc-routes
20512024-12-06T02:45:30.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58428 req_id = 8db83424-e97e-4f5e-b4e8-2e62bd61261a response_code = 204 uri = /vpc-routes
20522024-12-06T02:45:30.634ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20532024-12-06T02:45:30.682ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20542024-12-06T02:45:30.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83462 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50078 req_id = dfe85406-2de7-483c-a023-9e5d6eef5db6 response_code = 204 uri = /switch-ports
20552024-12-06T02:45:30.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 612 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50078 req_id = 57582414-e959-4812-b2b9-c420c48315ab response_code = 200 uri = /network-bootstore-config
20562024-12-06T02:45:30.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20572024-12-06T02:45:30.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169136 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37277 req_id = 71ddb534-66b4-4cd8-8fb2-3682e664e264 response_code = 204 uri = /switch-ports
20582024-12-06T02:45:30.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37277 req_id = 35754c8e-8d8e-472d-ae15-9674bed3660a response_code = 200 uri = /network-bootstore-config
20592024-12-06T02:45:42.619ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43580
20602024-12-06T02:45:42.619ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43580 req_id = ad82976d-f661-4fc2-8a06-8919b830911c response_code = 200 uri = /baseboard
20612024-12-06T02:45:45.042ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7333 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = b21993d8-10c8-4ede-bcfd-03be37848b4a response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
20622024-12-06T02:46:00.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47332
20632024-12-06T02:46:00.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47332 req_id = e707f512-59fa-49d8-a69f-70bbf4346042 response_code = 200 uri = /vpc-routes
20642024-12-06T02:46:00.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35282
20652024-12-06T02:46:00.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35282 req_id = 1668ac25-bad6-4576-8f6e-99949354ff4b response_code = 200 uri = /v2p
20662024-12-06T02:46:00.530ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
20672024-12-06T02:46:00.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47332 req_id = 1e617ed1-b24f-4dfc-8a0d-922ddbd87f37 response_code = 204 uri = /eip-gateways
20682024-12-06T02:46:00.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62327
20692024-12-06T02:46:00.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62327 req_id = 87d6aeee-321c-48cf-8b53-11478358fdac response_code = 200 uri = /vpc-routes
20702024-12-06T02:46:00.585ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
20712024-12-06T02:46:00.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62327 req_id = 4f053ae4-f9d1-44d9-889d-0d1eca80bc0e response_code = 204 uri = /eip-gateways
20722024-12-06T02:46:00.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62327 req_id = adab6004-4dbc-4ce1-ad58-7485e83bb812 response_code = 204 uri = /vpc-routes
20732024-12-06T02:46:00.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61820
20742024-12-06T02:46:00.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61820 req_id = 8b9b177a-aa8d-4fa0-a91c-ac3471d6be9b response_code = 200 uri = /vpc-routes
20752024-12-06T02:46:00.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60746
20762024-12-06T02:46:00.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60746 req_id = 550e0943-0459-4f6e-8823-3365cf47a851 response_code = 200 uri = /v2p
20772024-12-06T02:46:00.656ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
20782024-12-06T02:46:00.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61820 req_id = 4c7dce43-e124-4eaf-b6da-1d8552e3e72e response_code = 204 uri = /eip-gateways
20792024-12-06T02:46:00.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61820 req_id = de949eb4-d8f9-4e13-9556-273e067e57e9 response_code = 204 uri = /vpc-routes
20802024-12-06T02:46:00.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47332 req_id = 93f97dc4-eee5-4d81-8a74-02e7822d5ea1 response_code = 204 uri = /vpc-routes
20812024-12-06T02:46:00.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65096
20822024-12-06T02:46:00.764ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20832024-12-06T02:46:00.805ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20842024-12-06T02:46:00.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92262 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65096 req_id = 57bd5599-c1d1-4dc7-aa34-2af833acd506 response_code = 204 uri = /switch-ports
20852024-12-06T02:46:00.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49613
20862024-12-06T02:46:00.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49354
20872024-12-06T02:46:00.857ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20882024-12-06T02:46:00.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65096 req_id = 19c75f78-a953-4203-bd6d-a4a068e9b5c0 response_code = 200 uri = /network-bootstore-config
20892024-12-06T02:46:00.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49613 req_id = 3aa5cd8c-eaae-47e9-9040-660c65c94b3a response_code = 200 uri = /v2p
20902024-12-06T02:46:00.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56461
20912024-12-06T02:46:00.893ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20922024-12-06T02:46:00.947ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20932024-12-06T02:46:00.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49354 req_id = 685ee15a-3912-492d-8d90-af96959d192a response_code = 204 uri = /switch-ports
20942024-12-06T02:46:00.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 701 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49354 req_id = ab179bba-11a1-46e1-80f0-e71cd147a2c8 response_code = 200 uri = /network-bootstore-config
20952024-12-06T02:46:00.981ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20962024-12-06T02:46:01.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171991 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56461 req_id = a2bcf75c-b939-4895-b61d-f186cb694a0b response_code = 204 uri = /switch-ports
20972024-12-06T02:46:01.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56461 req_id = 43ff2a6e-2d12-4ef8-9f9b-67e146cd5544 response_code = 200 uri = /network-bootstore-config
20982024-12-06T02:46:12.652ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38127
20992024-12-06T02:46:12.652ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38127 req_id = 9cdd0794-8a32-449a-9c97-82489eabf071 response_code = 200 uri = /baseboard
21002024-12-06T02:46:15.041ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6625 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 5f7385f3-5ccd-4a59-baa4-bdb997d16bb4 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
21012024-12-06T02:46:30.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60909
21022024-12-06T02:46:30.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60909 req_id = 1e86dfd9-96b7-4021-93b3-1e7f55f4df82 response_code = 200 uri = /vpc-routes
21032024-12-06T02:46:30.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46826
21042024-12-06T02:46:30.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46826 req_id = 637be867-2616-42e2-86fb-07983b448909 response_code = 200 uri = /vpc-routes
21052024-12-06T02:46:30.291ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
21062024-12-06T02:46:30.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60909 req_id = 579ef27b-2561-49e2-95f6-3d2d0d85cdf1 response_code = 204 uri = /eip-gateways
21072024-12-06T02:46:30.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60909 req_id = 8914bf99-caeb-4e0b-b676-d4e7d111228f response_code = 204 uri = /vpc-routes
21082024-12-06T02:46:30.327ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
21092024-12-06T02:46:30.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46826 req_id = eb5b86cb-4425-4186-9575-26824d55834d response_code = 204 uri = /eip-gateways
21102024-12-06T02:46:30.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46826 req_id = de7eb573-6b6a-4f54-aa4f-ec9857672e26 response_code = 204 uri = /vpc-routes
21112024-12-06T02:46:30.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63035
21122024-12-06T02:46:30.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63035 req_id = 98393ef4-8233-48ad-852a-1dcee0474ea5 response_code = 200 uri = /v2p
21132024-12-06T02:46:30.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53379
21142024-12-06T02:46:30.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53379 req_id = ce4359a3-b272-4457-9df6-2ea97e8ae936 response_code = 200 uri = /vpc-routes
21152024-12-06T02:46:30.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53902
21162024-12-06T02:46:30.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53902 req_id = fd8a152a-8104-447c-b43a-8a3784f11d18 response_code = 200 uri = /v2p
21172024-12-06T02:46:30.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
21182024-12-06T02:46:30.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53379 req_id = 965a2385-49be-4252-a2e5-c629b141b67e response_code = 204 uri = /eip-gateways
21192024-12-06T02:46:30.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60700
21202024-12-06T02:46:30.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60700 req_id = b7b7a136-a4c2-471a-8255-bf0a706bb2b5 response_code = 200 uri = /v2p
21212024-12-06T02:46:30.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45672
21222024-12-06T02:46:30.492ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21232024-12-06T02:46:30.531ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21242024-12-06T02:46:30.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87514 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45672 req_id = 0bd57024-2356-434b-befb-864004ae5f97 response_code = 204 uri = /switch-ports
21252024-12-06T02:46:30.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63471
21262024-12-06T02:46:30.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48279
21272024-12-06T02:46:30.580ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21282024-12-06T02:46:30.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3446 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45672 req_id = 0a026847-5b50-433a-a1c3-9941ba97ee90 response_code = 200 uri = /network-bootstore-config
21292024-12-06T02:46:30.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 682 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53379 req_id = 636c4d17-682a-43c5-93b9-c0407b9422b9 response_code = 204 uri = /vpc-routes
21302024-12-06T02:46:30.614ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21312024-12-06T02:46:30.667ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21322024-12-06T02:46:30.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87462 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48279 req_id = cac09001-1dd5-4113-8457-44e8a9b81433 response_code = 204 uri = /switch-ports
21332024-12-06T02:46:30.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48279 req_id = 46419519-eebb-4353-b90a-91dd8c3c023a response_code = 200 uri = /network-bootstore-config
21342024-12-06T02:46:30.702ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21352024-12-06T02:46:30.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176593 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63471 req_id = 3a10d7dc-99ce-4f2d-87d3-75f966e7274a response_code = 204 uri = /switch-ports
21362024-12-06T02:46:30.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63471 req_id = 22d5e6b5-ed87-42b0-b65c-7c67f31b2808 response_code = 200 uri = /network-bootstore-config
21372024-12-06T02:46:42.686ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63162
21382024-12-06T02:46:42.686ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63162 req_id = 7e90ee6b-357c-47b2-b11b-95dc23ef7d31 response_code = 200 uri = /baseboard
21392024-12-06T02:46:45.041ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6716 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 98ee9a3c-569e-41dd-a72b-e471ebc105c6 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
21402024-12-06T02:47:00.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41784
21412024-12-06T02:47:00.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41784 req_id = 8c61666a-19ae-4503-9a13-b4653fa3a3a1 response_code = 200 uri = /vpc-routes
21422024-12-06T02:47:00.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34231
21432024-12-06T02:47:00.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34231 req_id = ca0df38e-17b2-4d74-8fa8-4ba0b157c709 response_code = 200 uri = /vpc-routes
21442024-12-06T02:47:00.390ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
21452024-12-06T02:47:00.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41784 req_id = 9ca464fb-3ef3-4228-a56d-f68076186f98 response_code = 204 uri = /eip-gateways
21462024-12-06T02:47:00.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41784 req_id = 5cd90f3b-5c9f-4567-a732-8cd1089ebe1a response_code = 204 uri = /vpc-routes
21472024-12-06T02:47:00.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53562
21482024-12-06T02:47:00.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53562 req_id = e8d27691-ce7e-4559-a2a8-bf6d782b785d response_code = 200 uri = /vpc-routes
21492024-12-06T02:47:00.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
21502024-12-06T02:47:00.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34231 req_id = 52d700b3-f61f-4c5f-85e1-11d277077c9a response_code = 204 uri = /eip-gateways
21512024-12-06T02:47:00.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34231 req_id = 4d0ff73c-3044-4bb3-9051-1ff458288dee response_code = 204 uri = /vpc-routes
21522024-12-06T02:47:00.504ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
21532024-12-06T02:47:00.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53562 req_id = 951c64c2-4fa6-4835-aa22-02a69e0bb0d4 response_code = 204 uri = /eip-gateways
21542024-12-06T02:47:00.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53562 req_id = 031667ed-9424-4cc1-bff6-41f5a4192343 response_code = 204 uri = /vpc-routes
21552024-12-06T02:47:00.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51661
21562024-12-06T02:47:00.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51661 req_id = c67de520-1cb2-47be-bf46-760f11dbf052 response_code = 200 uri = /v2p
21572024-12-06T02:47:00.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59155
21582024-12-06T02:47:00.632ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21592024-12-06T02:47:00.632ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21602024-12-06T02:47:00.632ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21612024-12-06T02:47:00.632ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21622024-12-06T02:47:00.632ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21632024-12-06T02:47:00.632ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21642024-12-06T02:47:00.632ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21652024-12-06T02:47:00.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59155 req_id = 6c3465b7-3e5f-412c-b3da-28bbee7ddfa9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21662024-12-06T02:47:00.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55351
21672024-12-06T02:47:00.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55351 req_id = 17b73e0c-8367-411e-831e-26237aa145fd response_code = 200 uri = /v2p
21682024-12-06T02:47:00.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62057
21692024-12-06T02:47:00.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62057 req_id = 3e698d17-3b17-496b-ba37-8120a81d602c response_code = 200 uri = /v2p
21702024-12-06T02:47:00.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63785
21712024-12-06T02:47:00.719ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21722024-12-06T02:47:00.756ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21732024-12-06T02:47:00.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93116 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63785 req_id = 7b4c1c91-9cd4-469c-b3f8-6558e69efccc response_code = 204 uri = /switch-ports
21742024-12-06T02:47:00.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47618
21752024-12-06T02:47:00.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43271
21762024-12-06T02:47:00.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21772024-12-06T02:47:00.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3588 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63785 req_id = 99e81427-a87a-455a-be55-eb40b2879ff3 response_code = 200 uri = /network-bootstore-config
21782024-12-06T02:47:00.848ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21792024-12-06T02:47:00.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64566
21802024-12-06T02:47:00.862ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21812024-12-06T02:47:00.862ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21822024-12-06T02:47:00.862ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21832024-12-06T02:47:00.862ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21842024-12-06T02:47:00.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21852024-12-06T02:47:00.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21862024-12-06T02:47:00.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21872024-12-06T02:47:00.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 717 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64566 req_id = b084a2b6-d327-4c25-a1b0-ba977a107f9e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21882024-12-06T02:47:00.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56528
21892024-12-06T02:47:00.893ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21902024-12-06T02:47:00.893ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21912024-12-06T02:47:00.893ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21922024-12-06T02:47:00.893ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21932024-12-06T02:47:00.894ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21942024-12-06T02:47:00.894ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21952024-12-06T02:47:00.894ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21962024-12-06T02:47:00.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3603 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56528 req_id = 279cad73-40ec-4b58-8fad-fbbfca029f96 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21972024-12-06T02:47:00.900ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21982024-12-06T02:47:00.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88057 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43271 req_id = ef0a4daf-2b68-4fd2-a333-463555327cf5 response_code = 204 uri = /switch-ports
21992024-12-06T02:47:00.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 676 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43271 req_id = 9d4c0a57-ae09-4c63-abf5-269a79d13e49 response_code = 200 uri = /network-bootstore-config
22002024-12-06T02:47:00.931ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22012024-12-06T02:47:00.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170885 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47618 req_id = 826a1cee-f653-4124-97ec-d85391353f6a response_code = 204 uri = /switch-ports
22022024-12-06T02:47:00.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47618 req_id = cdc40c23-50ae-47cb-a628-0dabe081adb1 response_code = 200 uri = /network-bootstore-config
22032024-12-06T02:47:12.720ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55563
22042024-12-06T02:47:12.720ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55563 req_id = 79670b03-a244-4353-9049-caa50ebcb787 response_code = 200 uri = /baseboard
22052024-12-06T02:47:15.042ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7306 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = ad0cc35e-828c-4f6f-aa8c-d04f2c7c1ee5 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
22062024-12-06T02:47:30.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37020
22072024-12-06T02:47:30.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37020 req_id = b2e45155-71a1-4e7d-9262-d224e05c5402 response_code = 200 uri = /vpc-routes
22082024-12-06T02:47:30.371ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
22092024-12-06T02:47:30.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37020 req_id = af74408c-e431-4822-8c50-f9c02748d159 response_code = 204 uri = /eip-gateways
22102024-12-06T02:47:30.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37020 req_id = 23f9ffce-f48d-4681-9a58-10534a6f6e04 response_code = 204 uri = /vpc-routes
22112024-12-06T02:47:30.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58677
22122024-12-06T02:47:30.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58677 req_id = 194b8971-5534-40bf-b097-6faf8d7abfc6 response_code = 200 uri = /v2p
22132024-12-06T02:47:30.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46309
22142024-12-06T02:47:30.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46309 req_id = bf75ce8b-c3c3-459b-abb5-151b283944ab response_code = 200 uri = /vpc-routes
22152024-12-06T02:47:30.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44040
22162024-12-06T02:47:30.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44040 req_id = 22a83cbb-3e58-4b1e-ab96-d38c11f9502f response_code = 200 uri = /vpc-routes
22172024-12-06T02:47:30.436ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
22182024-12-06T02:47:30.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46309 req_id = b8a33dfe-e749-4d9f-b7e8-1ae97915f2cd response_code = 204 uri = /eip-gateways
22192024-12-06T02:47:30.449ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
22202024-12-06T02:47:30.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44040 req_id = 2dcc4b99-539d-49ec-b8dd-bdce0ae6538a response_code = 204 uri = /eip-gateways
22212024-12-06T02:47:30.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46309 req_id = ff3e70c4-f06a-4a6f-b1b8-44dc00f21b80 response_code = 204 uri = /vpc-routes
22222024-12-06T02:47:30.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57680
22232024-12-06T02:47:30.452ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22242024-12-06T02:47:30.496ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22252024-12-06T02:47:30.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103967 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57680 req_id = d0c6d8bd-35e4-439e-a28a-e1c12696559d response_code = 204 uri = /switch-ports
22262024-12-06T02:47:30.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58281
22272024-12-06T02:47:30.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42859
22282024-12-06T02:47:30.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39569
22292024-12-06T02:47:30.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44808
22302024-12-06T02:47:30.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57680 req_id = 3a2c1c91-605d-47ce-b688-6bef826f59af response_code = 200 uri = /network-bootstore-config
22312024-12-06T02:47:30.556ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22322024-12-06T02:47:30.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42859 req_id = b9109323-0059-4d5d-8ed8-21fcc710632c response_code = 200 uri = /v2p
22332024-12-06T02:47:30.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 675 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44040 req_id = ef490b1c-cc07-4f7b-8002-083eec4691f5 response_code = 204 uri = /vpc-routes
22342024-12-06T02:47:30.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4971 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39569 req_id = 6ebcebea-7532-4d4b-97f4-23e9773a4b0a response_code = 200 uri = /v2p
22352024-12-06T02:47:30.597ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22362024-12-06T02:47:30.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22372024-12-06T02:47:30.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96868 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58281 req_id = e2a9f7c2-e485-489d-a573-a47b6f4af302 response_code = 204 uri = /switch-ports
22382024-12-06T02:47:30.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 385 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58281 req_id = 7f2f0be6-48b3-4c6b-9e23-60c1b24e647e response_code = 200 uri = /network-bootstore-config
22392024-12-06T02:47:30.688ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22402024-12-06T02:47:30.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185867 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44808 req_id = 077ca328-c9d1-4b05-b5e7-b4c487ebb1ec response_code = 204 uri = /switch-ports
22412024-12-06T02:47:30.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44808 req_id = d5f7329e-50f3-4596-b341-e06150538c0a response_code = 200 uri = /network-bootstore-config
22422024-12-06T02:47:42.753ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61303
22432024-12-06T02:47:42.753ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61303 req_id = 8e7cc27b-c99d-4c66-b4d9-a8e360186a31 response_code = 200 uri = /baseboard
22442024-12-06T02:47:45.042ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7609 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = cbf23014-bcea-4a50-bb49-0f55e6d3fc3f response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
22452024-12-06T02:48:00.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53085
22462024-12-06T02:48:00.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53085 req_id = d63a4ef8-a2f8-4153-a3f5-ff508466c2d8 response_code = 200 uri = /vpc-routes
22472024-12-06T02:48:00.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46366
22482024-12-06T02:48:00.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46366 req_id = b0781407-2f3c-4238-ab52-5147f90d26c5 response_code = 200 uri = /vpc-routes
22492024-12-06T02:48:00.530ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
22502024-12-06T02:48:00.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53085 req_id = 21feac57-788f-4493-9ed2-6316026367f3 response_code = 204 uri = /eip-gateways
22512024-12-06T02:48:00.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53085 req_id = 5980419a-566f-4c50-9456-5eeffe4a24d1 response_code = 204 uri = /vpc-routes
22522024-12-06T02:48:00.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35935
22532024-12-06T02:48:00.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35935 req_id = 82b00740-6366-4bb0-b6f4-d9c4042eed61 response_code = 200 uri = /vpc-routes
22542024-12-06T02:48:00.585ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
22552024-12-06T02:48:00.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46366 req_id = 253bff2a-9f10-4a94-8207-ab7a51e57f15 response_code = 204 uri = /eip-gateways
22562024-12-06T02:48:00.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46366 req_id = d6257e0b-166a-4c4c-a93c-c64e56cf6fff response_code = 204 uri = /vpc-routes
22572024-12-06T02:48:00.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44237
22582024-12-06T02:48:00.597ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22592024-12-06T02:48:00.643ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22602024-12-06T02:48:00.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105382 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44237 req_id = 3678374d-262a-4587-bd7a-2bd29eff5ca0 response_code = 204 uri = /switch-ports
22612024-12-06T02:48:00.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44465
22622024-12-06T02:48:00.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
22632024-12-06T02:48:00.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35935 req_id = 97991096-0c7c-44da-bfe1-e9a5b44a1ca4 response_code = 204 uri = /eip-gateways
22642024-12-06T02:48:00.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51295
22652024-12-06T02:48:00.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36857
22662024-12-06T02:48:00.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44237 req_id = 87484e8c-7b00-4521-bf96-afb950108c93 response_code = 200 uri = /network-bootstore-config
22672024-12-06T02:48:00.703ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22682024-12-06T02:48:00.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36857 req_id = 50e4b793-d581-4d20-a5e6-28e83b576884 response_code = 200 uri = /v2p
22692024-12-06T02:48:00.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51295 req_id = 1364f32f-bff9-45a9-bba4-30f748c045a3 response_code = 200 uri = /v2p
22702024-12-06T02:48:00.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40020
22712024-12-06T02:48:00.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40020 req_id = 91a56895-6393-489d-abbd-915caa093d7c response_code = 200 uri = /v2p
22722024-12-06T02:48:00.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 732 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35935 req_id = 27927ef8-67d3-4a3e-aa6c-2e1d6c719e97 response_code = 204 uri = /vpc-routes
22732024-12-06T02:48:00.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54644
22742024-12-06T02:48:00.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22752024-12-06T02:48:00.790ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22762024-12-06T02:48:00.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87631 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44465 req_id = d7c0c62d-1624-4f1d-b240-e56484f76e0a response_code = 204 uri = /switch-ports
22772024-12-06T02:48:00.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44465 req_id = 99ad217f-9872-489a-b8e8-60da8a33ef1c response_code = 200 uri = /network-bootstore-config
22782024-12-06T02:48:00.824ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22792024-12-06T02:48:00.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134068 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54644 req_id = ad58358a-040a-49a0-b727-926df921caec response_code = 204 uri = /switch-ports
22802024-12-06T02:48:00.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54644 req_id = f375e3d3-c572-4b60-967d-e5e8d60633d2 response_code = 200 uri = /network-bootstore-config
22812024-12-06T02:48:12.786ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34864
22822024-12-06T02:48:12.786ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34864 req_id = fd27c3d4-7c52-469f-803b-927fde4902ba response_code = 200 uri = /baseboard
22832024-12-06T02:48:15.041ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6999 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 35d0e17e-a1b6-4e32-82a1-35c3b46d0b1f response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
22842024-12-06T02:48:30.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63209
22852024-12-06T02:48:30.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63209 req_id = 85d9af10-01b3-4b84-82ad-8a7db22d15e8 response_code = 200 uri = /vpc-routes
22862024-12-06T02:48:30.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54136
22872024-12-06T02:48:30.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54136 req_id = 9c19e2bc-fa88-40ea-b706-9a073b873275 response_code = 200 uri = /vpc-routes
22882024-12-06T02:48:30.381ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
22892024-12-06T02:48:30.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63209 req_id = 49a3e733-400e-4914-a6a5-9d001d7c54a9 response_code = 204 uri = /eip-gateways
22902024-12-06T02:48:30.389ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
22912024-12-06T02:48:30.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54136 req_id = 62b9c979-3063-462c-a237-d74d2169d67d response_code = 204 uri = /eip-gateways
22922024-12-06T02:48:30.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63209 req_id = 483e2ece-add8-4523-bbee-2a5d2c7810e8 response_code = 204 uri = /vpc-routes
22932024-12-06T02:48:30.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54136 req_id = 21e2143e-c3ee-40d5-98f8-a4850d365bd7 response_code = 204 uri = /vpc-routes
22942024-12-06T02:48:30.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33624
22952024-12-06T02:48:30.408ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22962024-12-06T02:48:30.450ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22972024-12-06T02:48:30.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33624 req_id = 8518a8bd-68c5-4df6-852d-25335a615ba0 response_code = 204 uri = /switch-ports
22982024-12-06T02:48:30.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47675
22992024-12-06T02:48:30.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48577
23002024-12-06T02:48:30.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36869
23012024-12-06T02:48:30.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37834
23022024-12-06T02:48:30.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33624 req_id = a049f650-caef-4575-8f1d-69e3f28fa212 response_code = 200 uri = /network-bootstore-config
23032024-12-06T02:48:30.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44026
23042024-12-06T02:48:30.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47675 req_id = bfd7453f-811c-434c-aedc-02a714c8ba48 response_code = 200 uri = /vpc-routes
23052024-12-06T02:48:30.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37834 req_id = 49fdcd0e-c8fe-4e31-be7e-6c499d99ae49 response_code = 200 uri = /v2p
23062024-12-06T02:48:30.514ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23072024-12-06T02:48:30.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48577 req_id = f7ca64fa-ca3e-40b2-a8ca-03746ca8b39e response_code = 200 uri = /v2p
23082024-12-06T02:48:30.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42884
23092024-12-06T02:48:30.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42884 req_id = 8bcadea8-dcd7-4bc6-a04c-d1669a9ce1a4 response_code = 200 uri = /v2p
23102024-12-06T02:48:30.553ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23112024-12-06T02:48:30.562ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
23122024-12-06T02:48:30.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47675 req_id = 1076c44a-c4d4-408e-bb76-abb69af51b57 response_code = 204 uri = /eip-gateways
23132024-12-06T02:48:30.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 384 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47675 req_id = c35bfd78-5019-4188-8890-69d825c7a767 response_code = 204 uri = /vpc-routes
23142024-12-06T02:48:30.608ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23152024-12-06T02:48:30.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94079 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36869 req_id = e8da1746-f896-4f46-b658-65c35f2a548b response_code = 204 uri = /switch-ports
23162024-12-06T02:48:30.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 728 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36869 req_id = 3a66ef7b-e92d-4e51-9215-a3403f5a37bf response_code = 200 uri = /network-bootstore-config
23172024-12-06T02:48:30.641ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23182024-12-06T02:48:30.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176996 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44026 req_id = 9033e312-bcba-4799-a699-d9601119e0ad response_code = 204 uri = /switch-ports
23192024-12-06T02:48:30.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44026 req_id = d240c685-5603-4ccc-83ca-c1879ed49dd8 response_code = 200 uri = /network-bootstore-config
23202024-12-06T02:48:42.820ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40351
23212024-12-06T02:48:42.820ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40351 req_id = a81e4488-de52-4532-b667-fef334580b43 response_code = 200 uri = /baseboard
23222024-12-06T02:48:45.042ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8274 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = ff25319b-4670-4fee-b680-10d92b787162 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
23232024-12-06T02:49:00.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37412
23242024-12-06T02:49:00.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37412 req_id = 695c0d21-acd6-4db7-8d59-4f52edc346fb response_code = 200 uri = /vpc-routes
23252024-12-06T02:49:00.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36422
23262024-12-06T02:49:00.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36422 req_id = e8bfc71a-e881-48f5-9d61-09782d05681f response_code = 200 uri = /vpc-routes
23272024-12-06T02:49:00.496ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
23282024-12-06T02:49:00.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37412 req_id = eefdb992-9d99-496a-8d1a-3f6fe7d49021 response_code = 204 uri = /eip-gateways
23292024-12-06T02:49:00.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37412 req_id = 61f318d7-781a-495a-942c-29975542f6dc response_code = 204 uri = /vpc-routes
23302024-12-06T02:49:00.517ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
23312024-12-06T02:49:00.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36422 req_id = cbeabfd8-8afe-4a8a-8ed6-2c9c7210aceb response_code = 204 uri = /eip-gateways
23322024-12-06T02:49:00.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36422 req_id = 077b7fc4-aacd-4ae1-bbf4-e8888845cdf7 response_code = 204 uri = /vpc-routes
23332024-12-06T02:49:00.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48818
23342024-12-06T02:49:00.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48818 req_id = 65105763-0e2a-4a62-a26c-1c6960b68d03 response_code = 200 uri = /vpc-routes
23352024-12-06T02:49:00.600ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
23362024-12-06T02:49:00.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48818 req_id = e624b40b-5a4f-4c56-b11b-511ab26e6b24 response_code = 204 uri = /eip-gateways
23372024-12-06T02:49:00.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48818 req_id = 0cd285b3-48f1-459d-aa1f-5bd572914d7e response_code = 204 uri = /vpc-routes
23382024-12-06T02:49:00.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36899
23392024-12-06T02:49:00.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36899 req_id = 6f4be19a-d8d7-4e65-9dee-2ea7a1d79aa6 response_code = 200 uri = /v2p
23402024-12-06T02:49:00.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64209
23412024-12-06T02:49:00.677ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23422024-12-06T02:49:00.726ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23432024-12-06T02:49:00.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102522 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64209 req_id = aa584c57-3d34-4ed5-bc12-3915c4388c80 response_code = 204 uri = /switch-ports
23442024-12-06T02:49:00.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39802
23452024-12-06T02:49:00.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38140
23462024-12-06T02:49:00.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58536
23472024-12-06T02:49:00.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39802 req_id = 414014c7-dc99-44ba-9b05-27fc36950100 response_code = 200 uri = /v2p
23482024-12-06T02:49:00.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64209 req_id = d3e750a5-0fa3-4083-9d24-b12d7dae8be6 response_code = 200 uri = /network-bootstore-config
23492024-12-06T02:49:00.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62573
23502024-12-06T02:49:00.780ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23512024-12-06T02:49:00.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38140 req_id = 12cb79dc-b0e5-4a3b-979a-ed2b6125a631 response_code = 200 uri = /v2p
23522024-12-06T02:49:00.819ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23532024-12-06T02:49:00.871ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23542024-12-06T02:49:00.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91458 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58536 req_id = 2d6742ee-e384-44cd-86b8-3ad6214ec91c response_code = 204 uri = /switch-ports
23552024-12-06T02:49:00.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 658 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58536 req_id = b39792e4-b684-48ae-a8a8-75b22016a121 response_code = 200 uri = /network-bootstore-config
23562024-12-06T02:49:00.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23572024-12-06T02:49:00.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179748 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62573 req_id = f173890b-a6b8-4683-9c8f-9094c473a7c7 response_code = 204 uri = /switch-ports
23582024-12-06T02:49:00.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62573 req_id = 986a3e68-1bc3-44b6-a50e-fd7f7d0ffe12 response_code = 200 uri = /network-bootstore-config
23592024-12-06T02:49:12.854ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62259
23602024-12-06T02:49:12.854ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62259 req_id = 272ae21b-139b-4e20-9f1b-82b4ef1c0cfd response_code = 200 uri = /baseboard
23612024-12-06T02:49:15.042ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7926 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = d932d40d-40a0-4140-96ac-abb1b35bb64b response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
23622024-12-06T02:49:30.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43855
23632024-12-06T02:49:30.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43855 req_id = 798e6a5a-8dde-420b-98d7-dea7e1291378 response_code = 200 uri = /vpc-routes
23642024-12-06T02:49:30.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55717
23652024-12-06T02:49:30.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55717 req_id = bd8178c7-076e-422e-a016-5cd584475bcc response_code = 200 uri = /v2p
23662024-12-06T02:49:30.338ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
23672024-12-06T02:49:30.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43855 req_id = abf816ad-3618-4f3f-a403-504d3740db14 response_code = 204 uri = /eip-gateways
23682024-12-06T02:49:30.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43855 req_id = d25c56c3-3d08-4db0-9c4d-46a9364b5995 response_code = 204 uri = /vpc-routes
23692024-12-06T02:49:30.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35715
23702024-12-06T02:49:30.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35715 req_id = 23d37403-b7f2-4e74-aad2-7cc7d8d04b6b response_code = 200 uri = /vpc-routes
23712024-12-06T02:49:30.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53131
23722024-12-06T02:49:30.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23732024-12-06T02:49:30.433ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23742024-12-06T02:49:30.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82792 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53131 req_id = 1bb810c9-6901-45fd-8675-16c51b3bbcdb response_code = 204 uri = /switch-ports
23752024-12-06T02:49:30.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51491
23762024-12-06T02:49:30.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56276
23772024-12-06T02:49:30.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59805
23782024-12-06T02:49:30.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40615
23792024-12-06T02:49:30.484ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
23802024-12-06T02:49:30.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51491 req_id = e24c1d98-5d4a-4e07-bece-5aa54261749e response_code = 200 uri = /vpc-routes
23812024-12-06T02:49:30.484ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23822024-12-06T02:49:30.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35715 req_id = f439492b-9a89-476d-b0bb-fc16350a59d0 response_code = 204 uri = /eip-gateways
23832024-12-06T02:49:30.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56276 req_id = 400635eb-639d-4e84-bdca-d5ab2d0828c7 response_code = 200 uri = /v2p
23842024-12-06T02:49:30.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4587 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53131 req_id = 6a4d6f7a-d924-4824-a7d6-c1659804b3f6 response_code = 200 uri = /network-bootstore-config
23852024-12-06T02:49:30.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35715 req_id = 9fdcbb56-0eff-41e1-8887-fb9e5aa27d51 response_code = 204 uri = /vpc-routes
23862024-12-06T02:49:30.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54133
23872024-12-06T02:49:30.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54133 req_id = 808aaf80-cb91-4606-934a-150afd48e0de response_code = 200 uri = /v2p
23882024-12-06T02:49:30.525ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23892024-12-06T02:49:30.541ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
23902024-12-06T02:49:30.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 607 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51491 req_id = 001f14a4-075d-4fdf-a39c-f0619ad38d94 response_code = 204 uri = /eip-gateways
23912024-12-06T02:49:30.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 875 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51491 req_id = 24e3d7f4-323c-4619-b917-15d5aa7236af response_code = 204 uri = /vpc-routes
23922024-12-06T02:49:30.581ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23932024-12-06T02:49:30.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96909 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40615 req_id = 06fa0394-e869-4805-98d8-7aa6eee790b9 response_code = 204 uri = /switch-ports
23942024-12-06T02:49:30.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 738 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40615 req_id = 48e4a3f4-7d3e-4d87-b19e-d2f6b8929153 response_code = 200 uri = /network-bootstore-config
23952024-12-06T02:49:30.617ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23962024-12-06T02:49:30.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188818 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59805 req_id = 0efc7870-dae0-4913-a295-fbaae439d313 response_code = 204 uri = /switch-ports
23972024-12-06T02:49:30.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59805 req_id = bcdf5126-cfae-4769-93ec-4417ef4c9464 response_code = 200 uri = /network-bootstore-config
23982024-12-06T02:49:38.122ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23992024-12-06T02:49:38.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24002024-12-06T02:49:38.151ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 6726, tv_nsec: 519403505 } time_to_next_cleanup = 599.99999516s
24012024-12-06T02:49:42.886ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39061
24022024-12-06T02:49:42.886ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39061 req_id = c871985c-3955-46f6-945b-cec29a864fb9 response_code = 200 uri = /baseboard
24032024-12-06T02:49:45.041ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7460 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 1d579f0e-fe08-421e-808e-920953afb646 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
24042024-12-06T02:49:53.121ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24052024-12-06T02:50:00.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41112
24062024-12-06T02:50:00.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41112 req_id = 1a37d2d1-09b2-439c-b885-a7cb0525169e response_code = 200 uri = /vpc-routes
24072024-12-06T02:50:00.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49045
24082024-12-06T02:50:00.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49045 req_id = f69e2d00-b5d5-4b5b-85e9-2f264643fe01 response_code = 200 uri = /vpc-routes
24092024-12-06T02:50:00.424ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
24102024-12-06T02:50:00.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41112 req_id = fc0a926f-f3bb-4419-85a0-1f5c4a13738b response_code = 204 uri = /eip-gateways
24112024-12-06T02:50:00.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41112 req_id = 6d8ef2b4-8243-4285-9376-74282ca8431b response_code = 204 uri = /vpc-routes
24122024-12-06T02:50:00.498ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
24132024-12-06T02:50:00.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49045 req_id = cb048dfb-9381-48fe-851c-a5f96f65f336 response_code = 204 uri = /eip-gateways
24142024-12-06T02:50:00.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46271
24152024-12-06T02:50:00.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46271 req_id = 230966c9-50c0-4697-80ae-501be1ce4df3 response_code = 200 uri = /vpc-routes
24162024-12-06T02:50:00.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44372
24172024-12-06T02:50:00.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44372 req_id = a51544cf-68f3-46f4-9b9b-d03ae52717c4 response_code = 200 uri = /v2p
24182024-12-06T02:50:00.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49045 req_id = 0f60ca08-1ef1-402e-859e-b0219c82ef31 response_code = 204 uri = /vpc-routes
24192024-12-06T02:50:00.523ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
24202024-12-06T02:50:00.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46271 req_id = 24b9d462-b09f-489c-9d11-1f540139df07 response_code = 204 uri = /eip-gateways
24212024-12-06T02:50:00.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46271 req_id = 4041b9b0-e1b5-4dc2-a345-f157e0a0fc11 response_code = 204 uri = /vpc-routes
24222024-12-06T02:50:00.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41605
24232024-12-06T02:50:00.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41605 req_id = 3f125fd3-e02c-439e-ac47-cddf62b9a2c7 response_code = 200 uri = /v2p
24242024-12-06T02:50:00.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43879
24252024-12-06T02:50:00.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24262024-12-06T02:50:00.622ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24272024-12-06T02:50:00.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88230 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43879 req_id = c5fb9b32-7f50-47ae-8e89-63299c538309 response_code = 204 uri = /switch-ports
24282024-12-06T02:50:00.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51018
24292024-12-06T02:50:00.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51018 req_id = e649ab06-18df-4b7e-b5eb-2edb060c632f response_code = 200 uri = /v2p
24302024-12-06T02:50:00.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43879 req_id = c8812afb-082b-43d5-aceb-f4a4e362662b response_code = 200 uri = /network-bootstore-config
24312024-12-06T02:50:00.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52579
24322024-12-06T02:50:00.686ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24332024-12-06T02:50:00.721ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24342024-12-06T02:50:00.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86589 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52579 req_id = 14dde56d-a809-4845-a37c-11ad7b12ca65 response_code = 204 uri = /switch-ports
24352024-12-06T02:50:00.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43429
24362024-12-06T02:50:00.773ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24372024-12-06T02:50:00.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52579 req_id = 4bcf2a94-8027-495b-b81f-2b47dd3b5253 response_code = 200 uri = /network-bootstore-config
24382024-12-06T02:50:00.806ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24392024-12-06T02:50:00.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43429 req_id = 0ad096b2-c4df-471f-ac4c-1b9c547cdf9b response_code = 204 uri = /switch-ports
24402024-12-06T02:50:00.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43429 req_id = f895f593-5448-433b-b79c-ff88b5682e80 response_code = 200 uri = /network-bootstore-config
24412024-12-06T02:50:12.919ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52188
24422024-12-06T02:50:12.919ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52188 req_id = 063af927-a456-4b9e-b173-5d6b94531c3b response_code = 200 uri = /baseboard
24432024-12-06T02:50:15.042ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8710 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 187c3522-61f6-4ab3-9578-00a4f59cb955 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
24442024-12-06T02:50:30.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64078
24452024-12-06T02:50:30.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64078 req_id = 7b115dcc-52aa-4758-804b-43eaa6ab79e9 response_code = 200 uri = /vpc-routes
24462024-12-06T02:50:30.286ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
24472024-12-06T02:50:30.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64078 req_id = 317ecaca-2e55-4249-ae41-465409f534c2 response_code = 204 uri = /eip-gateways
24482024-12-06T02:50:30.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64078 req_id = 15fc34e7-36d8-4b45-b09b-39300a7c2f5d response_code = 204 uri = /vpc-routes
24492024-12-06T02:50:30.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37162
24502024-12-06T02:50:30.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37162 req_id = 6b05e4ee-9595-46c5-9e8b-d65a6c810caa response_code = 200 uri = /vpc-routes
24512024-12-06T02:50:30.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37344
24522024-12-06T02:50:30.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37344 req_id = 809cd7b5-002e-45de-96af-0c5afd4ec7fd response_code = 200 uri = /vpc-routes
24532024-12-06T02:50:30.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43423
24542024-12-06T02:50:30.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43423 req_id = 77477238-f00d-449b-8329-9e290f55d491 response_code = 200 uri = /v2p
24552024-12-06T02:50:30.395ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
24562024-12-06T02:50:30.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37162 req_id = eb171f4e-463f-410b-804b-6dabea3d2be3 response_code = 204 uri = /eip-gateways
24572024-12-06T02:50:30.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37162 req_id = 2c6b4391-67ed-4849-a3f6-d0b4f1ea655c response_code = 204 uri = /vpc-routes
24582024-12-06T02:50:30.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51919
24592024-12-06T02:50:30.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51919 req_id = 4cf2f550-9260-481e-8875-5db65505ec5a response_code = 200 uri = /v2p
24602024-12-06T02:50:30.470ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
24612024-12-06T02:50:30.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37344 req_id = adac1f43-9283-4e0f-9147-9b9f28269021 response_code = 204 uri = /eip-gateways
24622024-12-06T02:50:30.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34517
24632024-12-06T02:50:30.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34517 req_id = 478433a7-d138-46c0-adfd-17368238cd5b response_code = 200 uri = /v2p
24642024-12-06T02:50:30.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37344 req_id = 4f5fff6f-cf6c-4231-8c11-2e60ede40c3d response_code = 204 uri = /vpc-routes
24652024-12-06T02:50:30.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45636
24662024-12-06T02:50:30.487ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24672024-12-06T02:50:30.526ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24682024-12-06T02:50:30.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45636 req_id = 4dc79593-2573-4414-9efb-d06e9941b5ce response_code = 204 uri = /switch-ports
24692024-12-06T02:50:30.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54409
24702024-12-06T02:50:30.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52573
24712024-12-06T02:50:30.584ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24722024-12-06T02:50:30.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45636 req_id = 44edf517-9ed2-414a-a2bf-d27e044a8050 response_code = 200 uri = /network-bootstore-config
24732024-12-06T02:50:30.617ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24742024-12-06T02:50:30.671ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24752024-12-06T02:50:30.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87856 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54409 req_id = fbff9f7e-19dc-4aaa-8883-92dde17c9541 response_code = 204 uri = /switch-ports
24762024-12-06T02:50:30.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54409 req_id = a78e0d45-f5a8-44eb-b434-d877fafc594d response_code = 200 uri = /network-bootstore-config
24772024-12-06T02:50:30.705ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24782024-12-06T02:50:30.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175895 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52573 req_id = 6297a2a8-524b-4a13-91d7-4c3566e710bf response_code = 204 uri = /switch-ports
24792024-12-06T02:50:30.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52573 req_id = f968b6ca-49e5-4952-ae75-21f4f7517b80 response_code = 200 uri = /network-bootstore-config
24802024-12-06T02:50:42.954ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54748
24812024-12-06T02:50:42.955ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54748 req_id = 9b9fc41e-3fa4-4ada-aa5b-87b3fb165afa response_code = 200 uri = /baseboard
24822024-12-06T02:50:45.043ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9619 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 1ff1a0c9-6deb-41fc-88ae-e0438df6c18e response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
24832024-12-06T02:51:00.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34809
24842024-12-06T02:51:00.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34809 req_id = bc4ae34b-5e3c-4c1d-9906-2fdcfe3d75ce response_code = 200 uri = /vpc-routes
24852024-12-06T02:51:00.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48540
24862024-12-06T02:51:00.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48540 req_id = 69cb906f-7da2-42ba-abc5-907f1f0b4e21 response_code = 200 uri = /vpc-routes
24872024-12-06T02:51:00.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56344
24882024-12-06T02:51:00.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56344 req_id = 91d3cc71-b530-4278-9573-d95a3974e7e5 response_code = 200 uri = /vpc-routes
24892024-12-06T02:51:00.545ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
24902024-12-06T02:51:00.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34809 req_id = 50a05f7b-c10e-45fd-9326-f46c58f04816 response_code = 204 uri = /eip-gateways
24912024-12-06T02:51:00.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34809 req_id = 4486aeae-7ab8-4f78-869d-45b5c1d489fc response_code = 204 uri = /vpc-routes
24922024-12-06T02:51:00.576ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
24932024-12-06T02:51:00.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48540 req_id = 3805672c-ef7f-444c-8327-e82d7e5aa0e2 response_code = 204 uri = /eip-gateways
24942024-12-06T02:51:00.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
24952024-12-06T02:51:00.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56344 req_id = 7150a849-0e3c-44e7-a576-735aba3b54c8 response_code = 204 uri = /eip-gateways
24962024-12-06T02:51:00.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56344 req_id = 6ae6f4dc-2d82-44ce-b71e-3323fbdf96a9 response_code = 204 uri = /vpc-routes
24972024-12-06T02:51:00.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59382
24982024-12-06T02:51:00.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59382 req_id = 2425d818-6887-4bb8-9ed2-052b862d49ed response_code = 200 uri = /v2p
24992024-12-06T02:51:00.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48540 req_id = 849511c0-1bfb-4f3d-9116-a312d7fdd889 response_code = 204 uri = /vpc-routes
25002024-12-06T02:51:00.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38981
25012024-12-06T02:51:00.665ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25022024-12-06T02:51:00.706ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25032024-12-06T02:51:00.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99011 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38981 req_id = f3ce3a78-fac3-4941-85fa-914822437b3f response_code = 204 uri = /switch-ports
25042024-12-06T02:51:00.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55811
25052024-12-06T02:51:00.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49096
25062024-12-06T02:51:00.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48873
25072024-12-06T02:51:00.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49786
25082024-12-06T02:51:00.765ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25092024-12-06T02:51:00.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3822 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38981 req_id = 0f47290e-dd8a-4b1a-9bf5-51eb0d20a203 response_code = 200 uri = /network-bootstore-config
25102024-12-06T02:51:00.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3751 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48873 req_id = daf0c64e-c5d3-45ef-a9a0-f1707abfba63 response_code = 200 uri = /v2p
25112024-12-06T02:51:00.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3827 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49096 req_id = 4e6b3900-cc57-4193-b75a-9738731bbe50 response_code = 200 uri = /v2p
25122024-12-06T02:51:00.800ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25132024-12-06T02:51:00.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25142024-12-06T02:51:00.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94177 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49786 req_id = 53401d64-5fe1-4806-b57c-b3f44db3e80d response_code = 204 uri = /switch-ports
25152024-12-06T02:51:00.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 805 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49786 req_id = e5bcb8f1-61e8-482b-8358-a1412f47ba3b response_code = 200 uri = /network-bootstore-config
25162024-12-06T02:51:00.895ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25172024-12-06T02:51:00.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182146 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55811 req_id = 43cda435-386f-4f1b-9018-41028bfb9bbb response_code = 204 uri = /switch-ports
25182024-12-06T02:51:00.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55811 req_id = 43633be2-0695-4509-8d53-2a3e9aa03294 response_code = 200 uri = /network-bootstore-config
25192024-12-06T02:51:12.989ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52089
25202024-12-06T02:51:12.989ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52089 req_id = b931396b-c8cf-4097-b425-a5a3a0c0ca8f response_code = 200 uri = /baseboard
25212024-12-06T02:51:15.044ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10142 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 98a452bd-580d-413f-9123-cbb223003209 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
25222024-12-06T02:51:30.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59714
25232024-12-06T02:51:30.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59714 req_id = 2ec7fe63-9c27-4c90-9af3-0d83a23a9176 response_code = 200 uri = /vpc-routes
25242024-12-06T02:51:30.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55133
25252024-12-06T02:51:30.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55133 req_id = d7a2a96c-f4b7-4b5f-a940-3bebe9108226 response_code = 200 uri = /vpc-routes
25262024-12-06T02:51:30.333ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
25272024-12-06T02:51:30.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59714 req_id = 40520e0b-c345-44ad-8c33-5b23843e78ae response_code = 204 uri = /eip-gateways
25282024-12-06T02:51:30.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59714 req_id = 4d3a0d07-bd72-4246-a3b6-be91e3ce3cdf response_code = 204 uri = /vpc-routes
25292024-12-06T02:51:30.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65208
25302024-12-06T02:51:30.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65208 req_id = 1424ba8c-c755-427a-b126-04ec4ad7fa61 response_code = 200 uri = /vpc-routes
25312024-12-06T02:51:30.372ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
25322024-12-06T02:51:30.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55133 req_id = d9bacb90-9216-4a3a-b639-be51daebf304 response_code = 204 uri = /eip-gateways
25332024-12-06T02:51:30.380ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
25342024-12-06T02:51:30.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65208 req_id = ecd1e7d8-b85d-4f97-99c3-b9a8af030bad response_code = 204 uri = /eip-gateways
25352024-12-06T02:51:30.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55133 req_id = 44fb487f-46c5-4a42-a834-6a5255e37491 response_code = 204 uri = /vpc-routes
25362024-12-06T02:51:30.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65208 req_id = 3b2127b9-ccef-4c7c-946f-8bed9645195a response_code = 204 uri = /vpc-routes
25372024-12-06T02:51:30.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46363
25382024-12-06T02:51:30.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46363 req_id = be791154-e187-47f6-9015-c7978eb94319 response_code = 200 uri = /v2p
25392024-12-06T02:51:30.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48853
25402024-12-06T02:51:30.437ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25412024-12-06T02:51:30.484ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25422024-12-06T02:51:30.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102264 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48853 req_id = 871ba951-0922-4cbb-a4cf-efd18bbba81b response_code = 204 uri = /switch-ports
25432024-12-06T02:51:30.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41652
25442024-12-06T02:51:30.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58779
25452024-12-06T02:51:30.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58407
25462024-12-06T02:51:30.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54491
25472024-12-06T02:51:30.540ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25482024-12-06T02:51:30.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3898 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41652 req_id = 455c97f3-cfcd-4fec-af48-a2a3662432e3 response_code = 200 uri = /v2p
25492024-12-06T02:51:30.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3870 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58407 req_id = 4480106e-452d-4519-892f-5bf139cf9364 response_code = 200 uri = /v2p
25502024-12-06T02:51:30.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4005 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48853 req_id = 84a8d619-e2ee-4fd6-a7a4-70ebdf638065 response_code = 200 uri = /network-bootstore-config
25512024-12-06T02:51:30.576ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25522024-12-06T02:51:30.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25532024-12-06T02:51:30.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90770 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54491 req_id = 4518c69c-ae38-4057-ac2b-983458622f33 response_code = 204 uri = /switch-ports
25542024-12-06T02:51:30.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54491 req_id = 95e87c96-dc0e-459c-9253-6855270647bd response_code = 200 uri = /network-bootstore-config
25552024-12-06T02:51:30.664ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25562024-12-06T02:51:30.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58779 req_id = 73665c11-8703-4e51-9171-c0ebbac937fc response_code = 204 uri = /switch-ports
25572024-12-06T02:51:30.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58779 req_id = 289e4dbc-cfe7-4d7b-ab2f-53b4f99c9229 response_code = 200 uri = /network-bootstore-config
25582024-12-06T02:51:43.023ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37054
25592024-12-06T02:51:43.023ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37054 req_id = 2c82e794-fdb0-443b-81b2-18ffd66d22f5 response_code = 200 uri = /baseboard
25602024-12-06T02:51:45.042ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8074 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = ba05396a-0b30-40f6-9617-80d94e5e94df response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
25612024-12-06T02:52:00.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38399
25622024-12-06T02:52:00.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38399 req_id = 2955e2c8-8f0a-4e48-9f87-9f4878d686df response_code = 200 uri = /vpc-routes
25632024-12-06T02:52:00.556ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
25642024-12-06T02:52:00.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38399 req_id = 59b0ce47-1a20-4d2e-84b6-7118a0dd8058 response_code = 204 uri = /eip-gateways
25652024-12-06T02:52:00.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36390
25662024-12-06T02:52:00.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36390 req_id = 4fe935c4-f78e-4213-9ed7-1e077827064b response_code = 200 uri = /vpc-routes
25672024-12-06T02:52:00.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38791
25682024-12-06T02:52:00.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38791 req_id = be0bfe2b-11bc-4f7e-88bc-06dbe39553f5 response_code = 200 uri = /vpc-routes
25692024-12-06T02:52:00.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33126
25702024-12-06T02:52:00.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33126 req_id = 828f1408-b7dc-4c88-b7b8-f0ac91de3954 response_code = 200 uri = /v2p
25712024-12-06T02:52:00.613ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
25722024-12-06T02:52:00.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36390 req_id = f22559d3-abd8-4bfc-9c0f-8235b004c57b response_code = 204 uri = /eip-gateways
25732024-12-06T02:52:00.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34043
25742024-12-06T02:52:00.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25752024-12-06T02:52:00.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25762024-12-06T02:52:00.620ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-zones.json file = common/src/ledger.rs:177
25772024-12-06T02:52:00.620ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-zones.json file = common/src/ledger.rs:177
25782024-12-06T02:52:00.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1086 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38399 req_id = e90d2241-d676-47fc-a128-7e78c3a437dd response_code = 204 uri = /vpc-routes
25792024-12-06T02:52:00.635ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25802024-12-06T02:52:00.635ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2770546e-59fa-4ec3-8490-b551f4075d06
25812024-12-06T02:52:00.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33574
25822024-12-06T02:52:00.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33574 req_id = 85c36963-ee30-4cb8-80ba-1af2bcb400e8 response_code = 200 uri = /v2p
25832024-12-06T02:52:00.664ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
25842024-12-06T02:52:00.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38791 req_id = a2cd29c3-8cd9-4f11-b616-30184fc2ea06 response_code = 204 uri = /eip-gateways
25852024-12-06T02:52:00.664ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25862024-12-06T02:52:00.664ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5
25872024-12-06T02:52:00.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59830
25882024-12-06T02:52:00.669ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25892024-12-06T02:52:00.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38791 req_id = 924da812-02a6-4af8-a442-8a7b7f673aba response_code = 204 uri = /vpc-routes
25902024-12-06T02:52:00.698ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25912024-12-06T02:52:00.698ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2
25922024-12-06T02:52:00.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44463
25932024-12-06T02:52:00.720ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25942024-12-06T02:52:00.727ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25952024-12-06T02:52:00.727ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726
25962024-12-06T02:52:00.754ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25972024-12-06T02:52:00.754ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e1578fd-7835-4cef-bc2c-ab571a943504
25982024-12-06T02:52:00.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54384
25992024-12-06T02:52:00.759ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26002024-12-06T02:52:00.759ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26012024-12-06T02:52:00.759ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26022024-12-06T02:52:00.759ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26032024-12-06T02:52:00.759ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26042024-12-06T02:52:00.759ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26052024-12-06T02:52:00.759ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26062024-12-06T02:52:00.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 672 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54384 req_id = abfa362b-efd7-4795-a2ce-6a37ab7fa956 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26072024-12-06T02:52:00.779ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26082024-12-06T02:52:00.779ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb
26092024-12-06T02:52:00.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52072
26102024-12-06T02:52:00.789ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26112024-12-06T02:52:00.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119698 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59830 req_id = a49ac4b0-9298-416a-9cd6-5ee693639823 response_code = 204 uri = /switch-ports
26122024-12-06T02:52:00.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 745 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59830 req_id = 14f30e65-5b18-4d55-b3d2-0ec17d4621ba response_code = 200 uri = /network-bootstore-config
26132024-12-06T02:52:00.795ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26142024-12-06T02:52:00.795ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26152024-12-06T02:52:00.795ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-zones.json file = common/src/ledger.rs:177
26162024-12-06T02:52:00.799ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-zones.json file = common/src/ledger.rs:177
26172024-12-06T02:52:00.807ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26182024-12-06T02:52:00.807ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3215e18d-10da-4248-a0ac-1e11521027d3
26192024-12-06T02:52:00.820ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26202024-12-06T02:52:00.820ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2770546e-59fa-4ec3-8490-b551f4075d06
26212024-12-06T02:52:00.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50101
26222024-12-06T02:52:00.827ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26232024-12-06T02:52:00.827ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26242024-12-06T02:52:00.827ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26252024-12-06T02:52:00.827ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26262024-12-06T02:52:00.827ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26272024-12-06T02:52:00.827ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26282024-12-06T02:52:00.827ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26292024-12-06T02:52:00.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 432 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50101 req_id = e7463e57-fb37-4c3f-8eb1-c8cf16923d73 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26302024-12-06T02:52:00.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45115
26312024-12-06T02:52:00.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45115 req_id = f822bfb8-465d-4330-90da-f6fb1771572d response_code = 200 uri = /v2p
26322024-12-06T02:52:00.830ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26332024-12-06T02:52:00.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5448 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36390 req_id = 482db074-c69e-4ba2-bf8d-256f2f475692 response_code = 204 uri = /vpc-routes
26342024-12-06T02:52:00.849ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26352024-12-06T02:52:00.850ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5
26362024-12-06T02:52:00.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45392
26372024-12-06T02:52:00.866ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26382024-12-06T02:52:00.866ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea
26392024-12-06T02:52:00.883ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26402024-12-06T02:52:00.883ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2
26412024-12-06T02:52:00.898ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26422024-12-06T02:52:00.898ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867
26432024-12-06T02:52:00.902ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26442024-12-06T02:52:00.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193387 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44463 req_id = ff512de0-632f-4a62-9a18-38e7c646943a response_code = 204 uri = /switch-ports
26452024-12-06T02:52:00.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56769
26462024-12-06T02:52:00.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 423 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44463 req_id = a7a144f1-1524-459d-bd0c-6639b3a94fd7 response_code = 200 uri = /network-bootstore-config
26472024-12-06T02:52:00.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26482024-12-06T02:52:00.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26492024-12-06T02:52:00.913ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a67b500-470e-4683-b94c-e71013ff45af/config/omicron-zones.json file = common/src/ledger.rs:177
26502024-12-06T02:52:00.921ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/config/omicron-zones.json file = common/src/ledger.rs:177
26512024-12-06T02:52:00.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34043 req_id = 46b746f3-58f9-4369-bb80-8bb43586b7b2 response_code = 200 uri = /inventory
26522024-12-06T02:52:00.925ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26532024-12-06T02:52:00.925ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726
26542024-12-06T02:52:00.941ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2770546e-59fa-4ec3-8490-b551f4075d06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26552024-12-06T02:52:00.941ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2770546e-59fa-4ec3-8490-b551f4075d06
26562024-12-06T02:52:00.944ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26572024-12-06T02:52:00.969ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 10f0b4b9-eb5d-4ec5-8fab-f20611de79c5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26582024-12-06T02:52:00.969ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_10f0b4b9-eb5d-4ec5-8fab-f20611de79c5
26592024-12-06T02:52:00.987ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26602024-12-06T02:52:00.987ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e1578fd-7835-4cef-bc2c-ab571a943504
26612024-12-06T02:52:01.007ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8db23eba-4ce6-46cf-b966-87f40995e9c2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26622024-12-06T02:52:01.007ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8db23eba-4ce6-46cf-b966-87f40995e9c2
26632024-12-06T02:52:01.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161751 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45392 req_id = 75574459-3c79-4c60-b426-216a51222ac1 response_code = 204 uri = /switch-ports
26642024-12-06T02:52:01.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45392 req_id = f2a0603c-645e-47d2-a3e8-7a5504e802ca response_code = 200 uri = /network-bootstore-config
26652024-12-06T02:52:01.026ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26662024-12-06T02:52:01.026ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb
26672024-12-06T02:52:01.040ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7146dd23-d3fa-4c8c-a63b-91ff6591e726 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26682024-12-06T02:52:01.040ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7146dd23-d3fa-4c8c-a63b-91ff6591e726
26692024-12-06T02:52:01.066ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e1578fd-7835-4cef-bc2c-ab571a943504 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26702024-12-06T02:52:01.066ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e1578fd-7835-4cef-bc2c-ab571a943504
26712024-12-06T02:52:01.079ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26722024-12-06T02:52:01.079ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3215e18d-10da-4248-a0ac-1e11521027d3
26732024-12-06T02:52:01.095ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 34634e59-48bd-47f5-8bfe-ff4934b5a3bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26742024-12-06T02:52:01.095ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_34634e59-48bd-47f5-8bfe-ff4934b5a3bb
26752024-12-06T02:52:01.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65134
26762024-12-06T02:52:01.100ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ac59735-2254-4a20-8bbf-b592d1d8896f, kind: Service { id: 978be6b7-c081-4ef5-81fb-d8f564b5837d }, name: Name("external-dns-978be6b7-c081-4ef5-81fb-d8f564b5837d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a796cb9f-6a63-4947-8b02-d5c4a21082a2, kind: Service { id: 8862fdaf-bee3-4548-a137-b8038fc2a53e }, name: Name("external-dns-8862fdaf-bee3-4548-a137-b8038fc2a53e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f43b7de-2313-4814-b35d-fa8197a2702d, kind: Service { id: 762bf459-2b8d-4eb7-9936-2711780f30c8 }, name: Name("nexus-762bf459-2b8d-4eb7-9936-2711780f30c8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3188ed31-901d-49fe-8a8f-7e3d5d3e535a, kind: Service { id: ccdba72d-cbe7-4787-90d4-d52d38927b25 }, name: Name("nexus-ccdba72d-cbe7-4787-90d4-d52d38927b25"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 555f761c-4a6f-4842-ad5f-062f87560ea1, kind: Service { id: 3943088e-6ce0-4ada-925c-494df92c0dda }, name: Name("nexus-3943088e-6ce0-4ada-925c-494df92c0dda"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 165])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26772024-12-06T02:52:01.100ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26782024-12-06T02:52:01.100ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26792024-12-06T02:52:01.100ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26802024-12-06T02:52:01.100ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26812024-12-06T02:52:01.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26822024-12-06T02:52:01.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26832024-12-06T02:52:01.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 759 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65134 req_id = 22a997ea-3f41-4e32-bc88-d688545bdf33 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26842024-12-06T02:52:01.108ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26852024-12-06T02:52:01.108ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea
26862024-12-06T02:52:01.131ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26872024-12-06T02:52:01.131ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867
26882024-12-06T02:52:01.143ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3215e18d-10da-4248-a0ac-1e11521027d3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26892024-12-06T02:52:01.143ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3215e18d-10da-4248-a0ac-1e11521027d3
26902024-12-06T02:52:01.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 362841 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52072 req_id = 00688f02-7939-4eb9-8177-62e8e0443c75 response_code = 200 uri = /inventory
26912024-12-06T02:52:01.168ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 49a626ef-96f9-42b6-8143-bf2801f1f5ea (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26922024-12-06T02:52:01.168ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_49a626ef-96f9-42b6-8143-bf2801f1f5ea
26932024-12-06T02:52:01.191ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83a6f053-9a9e-49d7-aa01-2ac3088ef867 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26942024-12-06T02:52:01.191ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_83a6f053-9a9e-49d7-aa01-2ac3088ef867
26952024-12-06T02:52:01.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297451 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56769 req_id = 2783e5c5-f7cd-4325-ade7-f8e8d39238ce response_code = 200 uri = /inventory
26962024-12-06T02:52:13.055ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57831
26972024-12-06T02:52:13.056ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57831 req_id = ebe1e0d9-22c1-4bea-9ba3-d5fdb1a97f82 response_code = 200 uri = /baseboard
26982024-12-06T02:52:15.041ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7959 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = bde264a3-9393-48b5-8a2b-7130d1e5bf77 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
26992024-12-06T02:52:30.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59630
27002024-12-06T02:52:30.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59630 req_id = c505888e-9f7d-4aa3-8bde-e218cd86ed16 response_code = 200 uri = /vpc-routes
27012024-12-06T02:52:30.315ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
27022024-12-06T02:52:30.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59630 req_id = 3ab43172-8ca9-47a6-abf3-1be801030029 response_code = 204 uri = /eip-gateways
27032024-12-06T02:52:30.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39684
27042024-12-06T02:52:30.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39684 req_id = 56bdf9c9-9f75-4f4d-a9b1-3d724265e19c response_code = 200 uri = /vpc-routes
27052024-12-06T02:52:30.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45868
27062024-12-06T02:52:30.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45868 req_id = 8fdc4f7a-6580-47fe-8b9c-26fa65f3c2a7 response_code = 200 uri = /vpc-routes
27072024-12-06T02:52:30.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47466
27082024-12-06T02:52:30.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47466 req_id = d040584e-2d8e-4de6-b385-5aa97073e1e7 response_code = 200 uri = /v2p
27092024-12-06T02:52:30.388ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
27102024-12-06T02:52:30.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39684 req_id = 74a2d24c-e2fa-419c-857e-e59fb969ed8d response_code = 204 uri = /eip-gateways
27112024-12-06T02:52:30.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59630 req_id = 7d6dbc89-a801-4e2c-8ca5-5fdaf7382a75 response_code = 204 uri = /vpc-routes
27122024-12-06T02:52:30.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34654
27132024-12-06T02:52:30.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34654 req_id = 50f4c167-b4ad-448c-8b66-1ae0fac97075 response_code = 200 uri = /v2p
27142024-12-06T02:52:30.411ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
27152024-12-06T02:52:30.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45868 req_id = 3f2e5627-9800-4419-a7c6-e971ebca0605 response_code = 204 uri = /eip-gateways
27162024-12-06T02:52:30.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39684 req_id = 97165517-8ed1-4da0-8515-f0f6785a8d34 response_code = 204 uri = /vpc-routes
27172024-12-06T02:52:30.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50839
27182024-12-06T02:52:30.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50839 req_id = a95de259-6d73-43de-99bc-b9bb9627ea7f response_code = 200 uri = /v2p
27192024-12-06T02:52:30.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45868 req_id = b194e9f2-8add-4e28-bfc7-01b367aaf333 response_code = 204 uri = /vpc-routes
27202024-12-06T02:52:30.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45324
27212024-12-06T02:52:30.458ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27222024-12-06T02:52:30.496ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27232024-12-06T02:52:30.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93206 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45324 req_id = bd4cfd2d-5bbb-48ea-aa08-791cab11ecfd response_code = 204 uri = /switch-ports
27242024-12-06T02:52:30.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50012
27252024-12-06T02:52:30.551ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27262024-12-06T02:52:30.585ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27272024-12-06T02:52:30.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50012 req_id = 4beb92cd-ed35-4cb9-8b05-30ea57343365 response_code = 204 uri = /switch-ports
27282024-12-06T02:52:30.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51947
27292024-12-06T02:52:30.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45324 req_id = 6fb992d8-b322-49de-83f9-515cb811e6d6 response_code = 200 uri = /network-bootstore-config
27302024-12-06T02:52:30.638ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27312024-12-06T02:52:30.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50012 req_id = c881dc1d-b659-4d1b-83d0-51f5b26e7bd5 response_code = 200 uri = /network-bootstore-config
27322024-12-06T02:52:30.673ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27332024-12-06T02:52:30.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83350 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51947 req_id = 8a33f01c-52d7-4751-8cc4-51cdd51d45a1 response_code = 204 uri = /switch-ports
27342024-12-06T02:52:30.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51947 req_id = a00deeba-df7b-4022-b443-107807459c21 response_code = 200 uri = /network-bootstore-config
27352024-12-06T02:52:43.088ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49273
27362024-12-06T02:52:43.088ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49273 req_id = 5fc27f4b-b0b1-42c3-87ac-6b50ecb06381 response_code = 200 uri = /baseboard
27372024-12-06T02:52:45.040ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7187 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 423ec635-7fca-4d80-b402-62ee36f4743f response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
27382024-12-06T02:53:00.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60251
27392024-12-06T02:53:00.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60251 req_id = 4340f1d5-5138-4a92-9f23-414a132419ee response_code = 200 uri = /vpc-routes
27402024-12-06T02:53:00.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48380
27412024-12-06T02:53:00.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48380 req_id = 0dc59684-ad6a-4840-b9aa-4317f96e9982 response_code = 200 uri = /v2p
27422024-12-06T02:53:00.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58965
27432024-12-06T02:53:00.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58965 req_id = 5fdebc10-eea2-40df-be34-cb03d6263e54 response_code = 200 uri = /vpc-routes
27442024-12-06T02:53:00.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62496
27452024-12-06T02:53:00.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62496 req_id = fbc86a70-d1b5-45c3-bd03-0c2682c19c77 response_code = 200 uri = /vpc-routes
27462024-12-06T02:53:00.538ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
27472024-12-06T02:53:00.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60251 req_id = 08418ca2-8739-4c45-8a5d-f94e66aba93a response_code = 204 uri = /eip-gateways
27482024-12-06T02:53:00.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60251 req_id = 2cc18957-3111-4d58-9a72-a3c837cbbda8 response_code = 204 uri = /vpc-routes
27492024-12-06T02:53:00.584ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
27502024-12-06T02:53:00.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58965 req_id = 50ec1231-4a70-48bf-acdb-fee1b5d48d0d response_code = 204 uri = /eip-gateways
27512024-12-06T02:53:00.587ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
27522024-12-06T02:53:00.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62496 req_id = 0ffc1753-533f-44bc-9fe7-178687b1aa07 response_code = 204 uri = /eip-gateways
27532024-12-06T02:53:00.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58965 req_id = 1312edef-d871-4b87-9233-6d8189d20ea8 response_code = 204 uri = /vpc-routes
27542024-12-06T02:53:00.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62496 req_id = d283f440-9b5b-40de-ae15-8a1fe1be94cf response_code = 204 uri = /vpc-routes
27552024-12-06T02:53:00.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60526
27562024-12-06T02:53:00.635ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27572024-12-06T02:53:00.684ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27582024-12-06T02:53:00.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113038 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60526 req_id = fe5e7206-3ba5-4c7f-a448-4a631cb0b40f response_code = 204 uri = /switch-ports
27592024-12-06T02:53:00.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36712
27602024-12-06T02:53:00.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60526 req_id = 7bd99067-2d69-4c2a-b214-fa454cf8732b response_code = 200 uri = /network-bootstore-config
27612024-12-06T02:53:00.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36712 req_id = 3d1f1563-3840-4c43-ad92-8848f517e1d6 response_code = 200 uri = /v2p
27622024-12-06T02:53:00.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58402
27632024-12-06T02:53:00.757ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27642024-12-06T02:53:00.791ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27652024-12-06T02:53:00.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85944 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58402 req_id = 9704c421-e15e-4917-bb82-143fdf5c1a31 response_code = 204 uri = /switch-ports
27662024-12-06T02:53:00.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35786
27672024-12-06T02:53:00.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46174
27682024-12-06T02:53:00.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35786 req_id = c979ea6d-e286-489d-82ad-02bdf1dfcd52 response_code = 200 uri = /v2p
27692024-12-06T02:53:00.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27702024-12-06T02:53:00.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58402 req_id = 5abc3be6-58fa-446e-b5ce-8c73f21b41b2 response_code = 200 uri = /network-bootstore-config
27712024-12-06T02:53:00.875ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27722024-12-06T02:53:00.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85142 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46174 req_id = cd7fc6b7-a343-4dc4-a992-8b64636cf6ac response_code = 204 uri = /switch-ports
27732024-12-06T02:53:00.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46174 req_id = 153912cc-6a0c-46b5-9c00-da7eeb06c68e response_code = 200 uri = /network-bootstore-config
27742024-12-06T02:53:13.122ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39939
27752024-12-06T02:53:13.122ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39939 req_id = 605070a4-ee1e-405d-877c-a8400b506a25 response_code = 200 uri = /baseboard
27762024-12-06T02:53:15.042ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8509 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = b30c9258-2a00-4d62-856e-87eb37d07dd1 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
27772024-12-06T02:53:23.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35480
27782024-12-06T02:53:23.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35480 req_id = 8df29c19-ff48-477c-8dd3-322677ca4243 response_code = 200 uri = /v2p
27792024-12-06T02:53:23.799ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(10646420) }
27802024-12-06T02:53:23.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 645 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35480 req_id = 1305519d-053c-4e45-b4d8-0f249a6a6558 response_code = 204 uri = /v2p
27812024-12-06T02:53:23.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40526
27822024-12-06T02:53:23.912ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: dfbf3272-66a6-4fe7-aa45-045b658354f0, kind: Instance { id: ac2b3a9b-d712-4e39-8833-8cb85445305a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10646420), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfbf3272-66a6-4fe7-aa45-045b658354f0, kind: Instance { id: ac2b3a9b-d712-4e39-8833-8cb85445305a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10646420), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfbf3272-66a6-4fe7-aa45-045b658354f0, kind: Instance { id: ac2b3a9b-d712-4e39-8833-8cb85445305a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10646420), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10646420))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfbf3272-66a6-4fe7-aa45-045b658354f0, kind: Instance { id: ac2b3a9b-d712-4e39-8833-8cb85445305a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10646420), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-4106ff2123d", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 82bb6070-abea-47a9-9e8a-7ab54f7b552a, read_only_parent: Some(Volume { block_size: 512, id: aebdc380-39a8-48ed-b1aa-5ca62125d0a5, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7127d685-03cd-4699-929d-57572b1f11b4, key: Some("m+ci/zY99zqPlMc60ypsvdFWmc0ViEE/ExxdtPqUvC8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 82bb6070-abea-47a9-9e8a-7ab54f7b552a, key: Some("TfBrOTc0WsIHT+7uzwa/9gg+iE6O1U51eEq/q4MIVgw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::14]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-4106ff2123d" }] }), cloud_init_bytes: Some(..) } instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a metadata = InstanceMetadata { silo_id: 36adb3b8-4238-4eb5-8913-0041468585a1, project_id: e40bd336-a2d6-4a91-88a7-c1cfbdaddfdc } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-06T02:53:23.904307115Z }
27832024-12-06T02:53:23.912ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a migration_id = None propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
27842024-12-06T02:53:23.912ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a migration_id = None propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: dfbf3272-66a6-4fe7-aa45-045b658354f0, kind: Instance { id: ac2b3a9b-d712-4e39-8833-8cb85445305a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10646420), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfbf3272-66a6-4fe7-aa45-045b658354f0, kind: Instance { id: ac2b3a9b-d712-4e39-8833-8cb85445305a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10646420), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfbf3272-66a6-4fe7-aa45-045b658354f0, kind: Instance { id: ac2b3a9b-d712-4e39-8833-8cb85445305a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10646420), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10646420))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfbf3272-66a6-4fe7-aa45-045b658354f0, kind: Instance { id: ac2b3a9b-d712-4e39-8833-8cb85445305a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10646420), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-4106ff2123d", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 82bb6070-abea-47a9-9e8a-7ab54f7b552a, read_only_parent: Some(Volume { block_size: 512, id: aebdc380-39a8-48ed-b1aa-5ca62125d0a5, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7127d685-03cd-4699-929d-57572b1f11b4, key: Some("m+ci/zY99zqPlMc60ypsvdFWmc0ViEE/ExxdtPqUvC8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 82bb6070-abea-47a9-9e8a-7ab54f7b552a, key: Some("TfBrOTc0WsIHT+7uzwa/9gg+iE6O1U51eEq/q4MIVgw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::14]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-4106ff2123d" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-06T02:53:23.904307115Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27852024-12-06T02:53:23.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7025 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40526 req_id = 76961bcb-80e6-495a-ab63-c87b5396bfaa response_code = 200 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c
27862024-12-06T02:53:24.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42107
27872024-12-06T02:53:24.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42107 req_id = 91fb00ba-0869-421b-902a-2fdffb913bfb response_code = 200 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c/state
27882024-12-06T02:53:24.035ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 10646420 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27892024-12-06T02:53:24.035ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27902024-12-06T02:53:24.069ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c file = illumos-utils/src/zone.rs:325 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
27912024-12-06T02:53:24.092ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c file = illumos-utils/src/zone.rs:363 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
27922024-12-06T02:53:24.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37108
27932024-12-06T02:53:24.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37108 req_id = 2125eb8c-d88a-49c3-92e4-7da3f3f2946d response_code = 200 uri = /vpc-routes
27942024-12-06T02:53:24.186ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {dfbf3272-66a6-4fe7-aa45-045b658354f0: {10.151.1.175: {4a73a4f7-b655-42c4-be72-08366a465943}, 10.151.1.176: {4a73a4f7-b655-42c4-be72-08366a465943}}} }
27952024-12-06T02:53:25.427ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
27962024-12-06T02:53:25.428ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c zone file = illumos-utils/src/running_zone.rs:488 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c zone = oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c
27972024-12-06T02:53:25.670ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c") failed: Property not found. retry in 59.098464ms file = illumos-utils/src/svc.rs:36 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c zone = oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c
27982024-12-06T02:53:25.744ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c") failed: Property not found. retry in 72.612976ms file = illumos-utils/src/svc.rs:36 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c zone = oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c
27992024-12-06T02:53:25.830ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c") failed: Property not found. retry in 251.292449ms file = illumos-utils/src/svc.rs:36 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c zone = oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28002024-12-06T02:53:26.096ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c") failed: Property not found. retry in 596.291079ms file = illumos-utils/src/svc.rs:36 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c zone = oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28012024-12-06T02:53:26.707ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c") failed: Property not found. retry in 435.377875ms file = illumos-utils/src/svc.rs:36 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c zone = oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28022024-12-06T02:53:27.157ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c") failed: Property not found. retry in 1.433110794s file = illumos-utils/src/svc.rs:36 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c zone = oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28032024-12-06T02:53:28.603ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c") failed: Property not found. retry in 1.160196226s file = illumos-utils/src/svc.rs:36 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c zone = oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28042024-12-06T02:53:29.774ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c") failed: Property not found. retry in 1.460202043s file = illumos-utils/src/svc.rs:36 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c zone = oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28052024-12-06T02:53:30.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38734
28062024-12-06T02:53:30.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42945
28072024-12-06T02:53:30.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63683
28082024-12-06T02:53:30.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42733
28092024-12-06T02:53:30.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42733 req_id = c7c7cfaa-d4ca-4d39-978f-1c956daa1e2e response_code = 200 uri = /vpc-routes
28102024-12-06T02:53:30.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36392
28112024-12-06T02:53:30.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36392 req_id = 03859eaf-6caf-4be3-a0cb-47787aca476a response_code = 200 uri = /vpc-routes
28122024-12-06T02:53:30.380ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {dfbf3272-66a6-4fe7-aa45-045b658354f0: {10.151.1.175: {4a73a4f7-b655-42c4-be72-08366a465943}, 10.151.1.176: {4a73a4f7-b655-42c4-be72-08366a465943}}} }
28132024-12-06T02:53:30.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 672 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36392 req_id = 41c4735f-06fa-4fdb-aac8-bd4f9c845e86 response_code = 204 uri = /eip-gateways
28142024-12-06T02:53:30.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39242
28152024-12-06T02:53:30.402ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28162024-12-06T02:53:30.442ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28172024-12-06T02:53:30.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39242 req_id = 6286a3bb-37a7-4056-b945-55169b1e107c response_code = 204 uri = /switch-ports
28182024-12-06T02:53:30.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47061
28192024-12-06T02:53:30.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36988
28202024-12-06T02:53:30.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36292
28212024-12-06T02:53:30.502ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {dfbf3272-66a6-4fe7-aa45-045b658354f0: {10.151.1.175: {4a73a4f7-b655-42c4-be72-08366a465943}, 10.151.1.176: {4a73a4f7-b655-42c4-be72-08366a465943}}} }
28222024-12-06T02:53:30.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42733 req_id = 87fdeceb-92de-4ae3-95e3-e27427b1e81f response_code = 204 uri = /eip-gateways
28232024-12-06T02:53:30.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 379 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39242 req_id = 215e6e46-a866-4448-a366-5e551ae29163 response_code = 200 uri = /network-bootstore-config
28242024-12-06T02:53:30.503ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28252024-12-06T02:53:30.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4375 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36292 req_id = 832c874f-2534-4398-84d9-03bac44b86f5 response_code = 200 uri = /v2p
28262024-12-06T02:53:30.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5035 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36392 req_id = 92093ff0-55eb-4430-9ebe-e09132714eb8 response_code = 204 uri = /vpc-routes
28272024-12-06T02:53:30.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39684
28282024-12-06T02:53:30.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39684 req_id = a78ef411-32c7-4ffa-8d59-2ab3b4c7fa4c response_code = 200 uri = /v2p
28292024-12-06T02:53:30.543ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28302024-12-06T02:53:30.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40195
28312024-12-06T02:53:30.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40195 req_id = 04e189dc-6d5c-41c7-a7dd-ed5d6cfdf8f7 response_code = 200 uri = /v2p
28322024-12-06T02:53:30.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102791 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47061 req_id = a212cb09-2d85-4dd4-8dc1-2f187dd3522e response_code = 204 uri = /switch-ports
28332024-12-06T02:53:30.605ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28342024-12-06T02:53:30.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 758 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47061 req_id = cc94db14-e2b8-4c80-b710-6552f7683879 response_code = 200 uri = /network-bootstore-config
28352024-12-06T02:53:30.647ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28362024-12-06T02:53:30.681ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: fa7950f0-1322-4677-b575-7da6066834f3, version: 3 } old_vers = RouterVersion { router_id: fa7950f0-1322-4677-b575-7da6066834f3, version: 3 } subnet = RouterId { vni: Vni(10646420), kind: System }
28372024-12-06T02:53:30.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1027 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42733 req_id = f0d99c61-7f6c-463f-b5de-2bf5c7599b94 response_code = 204 uri = /vpc-routes
28382024-12-06T02:53:30.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36988 req_id = 7ffc07a8-3534-4497-ba36-9fc45f7779a2 response_code = 204 uri = /switch-ports
28392024-12-06T02:53:30.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36988 req_id = cbfdf8e0-6482-479c-9047-dd0ca547120f response_code = 200 uri = /network-bootstore-config
28402024-12-06T02:53:31.263ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c file = sled-agent/src/instance.rs:1786 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28412024-12-06T02:53:31.272ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c") failed: Property not found. retry in 52.067055ms file = illumos-utils/src/svc.rs:36 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28422024-12-06T02:53:31.335ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28432024-12-06T02:53:31.370ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28442024-12-06T02:53:31.509ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28452024-12-06T02:53:31.510ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
28462024-12-06T02:53:31.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7323425 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37108 req_id = 7c53b298-729f-49c1-9da9-327e2b927dfc response_code = 204 uri = /eip-gateways
28472024-12-06T02:53:31.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1166713 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63683 req_id = 5ea9c108-5147-4c9b-8894-fefe46226217 response_code = 200 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c/state
28482024-12-06T02:53:31.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1209643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38734 req_id = 998b67d1-9027-4501-905d-84df1d8e6c62 response_code = 200 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c/state
28492024-12-06T02:53:31.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1200397 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42945 req_id = 9d906678-c202-45fb-8a57-0954bf6f2bf9 response_code = 200 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c/state
28502024-12-06T02:53:31.513ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-06T02:53:31.513767497Z } file = sled-agent/src/instance.rs:780 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28512024-12-06T02:53:31.513ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-06T02:53:31.513767497Z } propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28522024-12-06T02:53:31.513ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-06T02:53:31.513767497Z }, migration_in: None, migration_out: None }
28532024-12-06T02:53:31.556ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-06T02:53:31.556353063Z } file = sled-agent/src/instance.rs:780 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28542024-12-06T02:53:31.556ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-06T02:53:31.556353063Z } propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28552024-12-06T02:53:31.556ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-06T02:53:31.556353063Z }, migration_in: None, migration_out: None }
28562024-12-06T02:53:31.672ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: fa7950f0-1322-4677-b575-7da6066834f3, version: 3 } old_vers = RouterVersion { router_id: fa7950f0-1322-4677-b575-7da6066834f3, version: 3 } subnet = RouterId { vni: Vni(10646420), kind: System }
28572024-12-06T02:53:31.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37108 req_id = 22003bf6-a9cb-4d45-ba74-dbf8d924ac68 response_code = 204 uri = /vpc-routes
28582024-12-06T02:53:31.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55294
28592024-12-06T02:53:31.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55294 req_id = 66ecbfa7-fef5-4504-9b91-5f93c97a3b3c response_code = 200 uri = /vpc-routes
28602024-12-06T02:53:31.780ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {dfbf3272-66a6-4fe7-aa45-045b658354f0: {10.151.1.175: {4a73a4f7-b655-42c4-be72-08366a465943}, 10.151.1.176: {4a73a4f7-b655-42c4-be72-08366a465943}}} }
28612024-12-06T02:53:31.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55294 req_id = 872089c2-1c04-46e2-b61f-575e6b17005e response_code = 204 uri = /eip-gateways
28622024-12-06T02:53:31.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55294 req_id = 1bcea82b-fac9-495a-a4c4-91298d1a9f73 response_code = 204 uri = /vpc-routes
28632024-12-06T02:53:41.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33582
28642024-12-06T02:53:41.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 507 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33582 req_id = 0704af44-ac2e-43c7-8b5b-b1bf95cd8e72 response_code = 200 uri = /vmms/3c341a9c-82c0-49f4-9e74-b3a3ba58635c/state
28652024-12-06T02:53:41.604ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-06T02:53:41.604607436Z } file = sled-agent/src/instance.rs:780 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28662024-12-06T02:53:41.604ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-06T02:53:41.604607436Z } propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28672024-12-06T02:53:41.604ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-06T02:53:41.604607436Z }, migration_in: None, migration_out: None }
28682024-12-06T02:53:41.616ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-06T02:53:41.616700121Z } file = sled-agent/src/instance.rs:780 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28692024-12-06T02:53:41.616ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-06T02:53:41.616700121Z } propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28702024-12-06T02:53:41.616ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28712024-12-06T02:53:41.616ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28722024-12-06T02:53:41.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28732024-12-06T02:53:41.617ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/2e87fdf2-7d81-430e-8589-c4a1bfb0a9ab/debug/bundle/zone", "/pool/int/3a67b500-470e-4683-b94c-e71013ff45af/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/2770546e-59fa-4ec3-8490-b551f4075d06/crypt/debug", "/pool/ext/10f0b4b9-eb5d-4ec5-8fab-f20611de79c5/crypt/debug", "/pool/ext/8db23eba-4ce6-46cf-b966-87f40995e9c2/crypt/debug", "/pool/ext/7146dd23-d3fa-4c8c-a63b-91ff6591e726/crypt/debug", "/pool/ext/2e1578fd-7835-4cef-bc2c-ab571a943504/crypt/debug", "/pool/ext/34634e59-48bd-47f5-8bfe-ff4934b5a3bb/crypt/debug", "/pool/ext/3215e18d-10da-4248-a0ac-1e11521027d3/crypt/debug", "/pool/ext/49a626ef-96f9-42b6-8143-bf2801f1f5ea/crypt/debug", "/pool/ext/83a6f053-9a9e-49d7-aa01-2ac3088ef867/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28742024-12-06T02:53:41.617ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 15520033723011506242 n_samples = 6 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
28752024-12-06T02:53:41.617ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 8454962392577110714 n_samples = 6 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
28762024-12-06T02:53:42.249ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c", bundle_id: 97164506-d484-4e90-80a1-e5509eeed9d5 }, time_created: 2024-12-06T02:53:41.617597116Z, version: 0, cause: TerminatedInstance }
28772024-12-06T02:53:42.249ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_3c341a9c-82c0-49f4-9e74-b3a3ba58635c file = sled-agent/src/instance.rs:1032 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28782024-12-06T02:53:43.154ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36812
28792024-12-06T02:53:43.154ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36812 req_id = 1bd6a46b-6f90-42ff-a82a-315770b258c0 response_code = 200 uri = /baseboard
28802024-12-06T02:53:44.021ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28812024-12-06T02:53:44.038ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(10646420), kind: System }
28822024-12-06T02:53:44.038ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(10646420), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28832024-12-06T02:53:44.038ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T02:53:44.038622200Z }, migration_in: None, migration_out: None }
28842024-12-06T02:53:44.064ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T02:53:44.038622200Z }, migration_in: None, migration_out: None }
28852024-12-06T02:53:44.069ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = ac2b3a9b-d712-4e39-8833-8cb85445305a propolis_id = 3c341a9c-82c0-49f4-9e74-b3a3ba58635c
28862024-12-06T02:53:44.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48252
28872024-12-06T02:53:44.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48252 req_id = a8455fba-d556-46d0-89b5-3c4d128d4314 response_code = 200 uri = /vpc-routes
28882024-12-06T02:53:44.584ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {dfbf3272-66a6-4fe7-aa45-045b658354f0: {10.151.1.175: {4a73a4f7-b655-42c4-be72-08366a465943}, 10.151.1.176: {4a73a4f7-b655-42c4-be72-08366a465943}}} }
28892024-12-06T02:53:44.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48252 req_id = 50838668-fb71-499f-b5c7-b95bb769739b response_code = 204 uri = /eip-gateways
28902024-12-06T02:53:44.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48252 req_id = 87fa732b-6e0e-4593-98ce-f1bfc475fb98 response_code = 204 uri = /vpc-routes
28912024-12-06T02:53:44.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47936
28922024-12-06T02:53:44.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47936 req_id = 65748a83-09e3-4a3f-a4ea-2bf09ba81017 response_code = 200 uri = /v2p
28932024-12-06T02:53:45.043ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10246 local_addr = [fd00:1122:3344:101::1]:38591 method = GET remote_addr = [fd00:1122:3344:101::d]:59181 req_id = 0b3bf39c-3637-4cc9-8320-7c2463566d82 response_code = 200 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe uri = /5455a27f-b1dd-4d8d-adde-726221dabebe
28942024-12-06T02:53:45.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52869
28952024-12-06T02:53:45.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52869 req_id = c433019e-ac09-4917-83a4-bbb3e932bf0b response_code = 200 uri = /v2p
28962024-12-06T02:53:45.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39561
28972024-12-06T02:53:45.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39561 req_id = 7156b051-88db-4e26-b7cf-9ec71d96df96 response_code = 200 uri = /vpc-routes
28982024-12-06T02:53:45.162ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
28992024-12-06T02:53:45.162ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe
29002024-12-06T02:53:45.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39561 req_id = eee78225-69c6-4fda-b9fa-1154930b86d6 response_code = 204 uri = /eip-gateways
29012024-12-06T02:53:45.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39561 req_id = 54f8e8eb-2367-48ef-b55c-d1d68ad8b662 response_code = 204 uri = /vpc-routes
29022024-12-06T02:53:45.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50984
29032024-12-06T02:53:45.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50984 req_id = 3d0528f0-cf7e-41f0-abfb-9d53b2340931 response_code = 200 uri = /vpc-routes
29042024-12-06T02:53:45.955ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 5455a27f-b1dd-4d8d-adde-726221dabebe values = ExternalIpGatewayMap { mappings: {} }
29052024-12-06T02:53:45.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50984 req_id = ff42c487-a33c-4daa-8f8d-b5814fc99a67 response_code = 204 uri = /eip-gateways
29062024-12-06T02:53:45.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50984 req_id = 98b662c0-2765-41ad-9b95-f42a16c68547 response_code = 204 uri = /vpc-routes