Max level shown:
1 [ Nov 28 01:50:53 Enabled. ]
2 [ Nov 28 01:50:53 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 28 01:50:53 Method "start" exited with status 0. ]
4 [ Nov 28 01:50:53 Rereading configuration. ]
5 [ Nov 28 01:50:53 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-28T01:50:53.085ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-28T01:50:53.085ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-28T01:50:53.137ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-28T01:50:53.137ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-28T01:50:53.252ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-28T01:50:53.260ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-28T01:50:53.269ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-28T01:50:53.870ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-28T01:50:54.010ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-28T01:50:54.010ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-28T01:50:54.010ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-28T01:50:54.010ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-28T01:50:54.010ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-28T01:50:54.010ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-28T01:50:54.013ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-28T01:50:54.013ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-28T01:50:54.013ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-28T01:50:54.013ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-28T01:50:54.013ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-28T01:50:54.013ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-28T01:50:54.013ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-28T01:50:54.013ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-28T01:50:54.013ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-28T01:50:54.024ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-28T01:50:54.024ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool)
322024-11-28T01:50:54.123ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal }
332024-11-28T01:50:54.592ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-28T01:50:54.592ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-28T01:50:54.592ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-28T01:50:54.593ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-28T01:50:54.593ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-28T01:50:54.593ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-28T01:50:54.593ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-28T01:50:54.601ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-28T01:50:54.601ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool)
422024-11-28T01:50:54.688ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal }
432024-11-28T01:50:55.158ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-28T01:50:55.158ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-28T01:50:55.158ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-28T01:50:55.158ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-28T01:50:55.158ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-28T01:50:55.158ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-28T01:50:55.158ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
522024-11-28T01:50:55.158ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-11-28T01:50:55.158ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-28T01:50:55.158ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-28T01:50:55.158ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-11-28T01:50:55.158ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-28T01:50:55.158ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-28T01:50:55.158ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-11-28T01:50:55.158ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-11-28T01:50:55.158ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-11-28T01:50:55.158ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-28T01:50:55.158ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-28T01:50:55.158ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
702024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
712024-11-28T01:50:55.158ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
722024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-11-28T01:50:55.158ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-28T01:50:55.158ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-28T01:50:55.158ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-28T01:50:55.158ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-28T01:50:55.158ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-28T01:50:55.158ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-28T01:50:55.158ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
832024-11-28T01:50:55.158ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842024-11-28T01:50:55.158ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-28T01:50:55.158ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-28T01:50:55.158ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-11-28T01:50:55.158ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
882024-11-28T01:50:55.159ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
892024-11-28T01:50:55.159ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
902024-11-28T01:50:55.159ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-28T01:50:55.159ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-28T01:50:55.159ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-28T01:50:55.159ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942024-11-28T01:50:55.159ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952024-11-28T01:50:55.159ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-28T01:50:55.159ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-28T01:50:55.159ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-28T01:50:55.159ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-28T01:50:55.159ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-28T01:50:55.159ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-28T01:50:55.159ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-28T01:50:55.159ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-28T01:50:55.159ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-28T01:50:55.159ZINFOSledAgent (bootstore): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-11-28T01:50:55.159ZINFOSledAgent (bootstore): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-11-28T01:50:55.159ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-28T01:50:55.159ZINFOSledAgent (bootstore): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-11-28T01:50:55.159ZINFOSledAgent (bootstore): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-11-28T01:50:55.159ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-28T01:50:55.159ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-28T01:50:55.159ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-28T01:50:55.170ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-28T01:50:55.170ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1321, tv_nsec: 27018039 } time_to_next_cleanup = 599.999918468s
1142024-11-28T01:50:55.170ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-28T01:50:55.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-28T01:50:55.170ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-28T01:50:55.173ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-28T01:50:55.173ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-28T01:50:55.175ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-28T01:50:55.175ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1187
1212024-11-28T01:50:55.175ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-28T01:50:55.176ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-28T01:50:55.176ZINFOSledAgent (RSS): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-28T01:50:55.176ZINFOSledAgent (RSS): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-28T01:50:55.176ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1250
1262024-11-28T01:50:55.176ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-28T01:50:55.176ZINFOSledAgent (RSS): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-28T01:50:55.176ZINFOSledAgent (RSS): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-28T01:50:55.176ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1292
1302024-11-28T01:50:55.176ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-28T01:50:55.176ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-28T01:50:55.176ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-28T01:50:55.176ZINFOSledAgent (RSS): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-28T01:50:55.176ZINFOSledAgent (RSS): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-28T01:50:55.176ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 92a8ff6e-21d3-4c28-bcad-e323847985dc, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 313847b3-d670-4167-9b09-9e7d3dfcb2a4 (sled), rack_id: 92a8ff6e-21d3-4c28-bcad-e323847985dc, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-28T01:50:55.176ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1326
1372024-11-28T01:50:55.176ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-11-28T01:50:55.176ZINFOSledAgent (bootstore): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-11-28T01:50:55.176ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-11-28T01:50:55.177ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-11-28T01:50:55.177ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 313847b3-d670-4167-9b09-9e7d3dfcb2a4 (sled), rack_id: 92a8ff6e-21d3-4c28-bcad-e323847985dc, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-11-28T01:50:55.177ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-28T01:50:55.177ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-28T01:50:55.182ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-28T01:50:55.188ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-28T01:50:55.188ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-28T01:50:55.192ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-28T01:50:55.192ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-28T01:50:55.193ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:60846
1502024-11-28T01:50:55.193ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 313847b3-d670-4167-9b09-9e7d3dfcb2a4 (sled), rack_id: 92a8ff6e-21d3-4c28-bcad-e323847985dc, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-28T01:50:55.193ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-28T01:50:55.193ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-28T01:50:55.193ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-28T01:50:55.193ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-28T01:50:55.193ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562024-11-28T01:50:55.193ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1572024-11-28T01:50:55.193ZINFOSledAgent (StorageManager): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-28T01:50:55.193ZINFOSledAgent (StorageManager): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-28T01:50:55.193ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-28T01:50:55.193ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-28T01:50:55.193ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-28T01:50:55.193ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-28T01:50:55.193ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-28T01:50:55.209ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-28T01:50:55.230ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-28T01:50:55.247ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-28T01:50:55.272ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
1682024-11-28T01:50:55.272ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-28T01:50:55.272ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
1702024-11-28T01:50:55.272ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-28T01:50:55.275ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 106.506579ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5df926a1-5ae6-4ede-a5e7-c03efcc265f6", "content-length": "124", "date": "Thu, 28 Nov 2024 01:50:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5df926a1-5ae6-4ede-a5e7-c03efcc265f6" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-28T01:50:55.285ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_76f1d962-0f92-42e6-af9d-3f59d408bbbd/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-28T01:50:55.308ZINFOSledAgent: successfully created encrypted zvol: name="oxi_76f1d962-0f92-42e6-af9d-3f59d408bbbd/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-28T01:50:55.308ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_76f1d962-0f92-42e6-af9d-3f59d408bbbd/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-28T01:50:55.313ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
1762024-11-28T01:50:55.313ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-28T01:50:55.313ZINFOSledAgent (BackingFs): Ensuring dataset oxi_76f1d962-0f92-42e6-af9d-3f59d408bbbd/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-28T01:50:55.383ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-28T01:50:55.384ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 155.229733ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "88139d0f-4e7c-462d-93f0-62a7f3fd0acf", "content-length": "124", "date": "Thu, 28 Nov 2024 01:50:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "88139d0f-4e7c-462d-93f0-62a7f3fd0acf" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-28T01:50:55.397ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-28T01:50:55.540ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-28T01:50:55.540ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 209.629757ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4fab5aca-2410-48a6-9bb4-32987465d99a", "content-length": "124", "date": "Thu, 28 Nov 2024 01:50:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4fab5aca-2410-48a6-9bb4-32987465d99a" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-28T01:50:55.616ZINFOSledAgent (BackingFs): Mounting oxi_76f1d962-0f92-42e6-af9d-3f59d408bbbd/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-28T01:50:55.629ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-11-28T01:50:55.629ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-11-28T01:50:55.629ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-11-28T01:50:55.630ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-11-28T01:50:55.751ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-28T01:50:55.751ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 151.021152ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f9659b89-ba60-486c-af9b-f4393da89d5e", "content-length": "124", "date": "Thu, 28 Nov 2024 01:50:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f9659b89-ba60-486c-af9b-f4393da89d5e" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-28T01:50:55.904ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-28T01:50:55.904ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 143.118318ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0b0de7aa-c11d-478c-be41-ccd03a407fd9", "content-length": "124", "date": "Thu, 28 Nov 2024 01:50:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0b0de7aa-c11d-478c-be41-ccd03a407fd9" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-28T01:50:56.049ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-28T01:50:56.050ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 297.672333ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "64094f15-3655-4c4c-82cd-ff56dc6a5ee3", "content-length": "124", "date": "Thu, 28 Nov 2024 01:50:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "64094f15-3655-4c4c-82cd-ff56dc6a5ee3" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-28T01:50:56.349ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-28T01:50:56.368ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
1962024-11-28T01:50:56.373ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:57643 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
1972024-11-28T01:50:56.373ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
1982024-11-28T01:50:56.373ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:57643 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
1992024-11-28T01:50:56.374ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 194.161913ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2002024-11-28T01:50:56.375ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2012024-11-28T01:50:56.375ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2022024-11-28T01:50:56.375ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2032024-11-28T01:50:56.375ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2042024-11-28T01:50:56.571ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 693.954647ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2052024-11-28T01:50:57.267ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.186852313s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2062024-11-28T01:50:58.456ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.022666488s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2072024-11-28T01:50:59.091ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2082024-11-28T01:50:59.091ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2092024-11-28T01:50:59.091ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2102024-11-28T01:50:59.091ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2112024-11-28T01:50:59.091ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2122024-11-28T01:50:59.091ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2132024-11-28T01:50:59.093ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2142024-11-28T01:50:59.095ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2152024-11-28T01:50:59.095ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='27b44fd9-9dc4-42a5-82e8-5084c0434475'/> <propval type="astring" name="rack_id" value='92a8ff6e-21d3-4c28-bcad-e323847985dc'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe5c:2ae4'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='92a8ff6e-21d3-4c28-bcad-e323847985dc'/> <propval type="astring" name="sled_id" value='313847b3-d670-4167-9b09-9e7d3dfcb2a4'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='313847b3-d670-4167-9b09-9e7d3dfcb2a4'/> <propval type="astring" name="rack_uuid" value='92a8ff6e-21d3-4c28-bcad-e323847985dc'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='313847b3-d670-4167-9b09-9e7d3dfcb2a4'/> <propval type="astring" name="rack_uuid" value='92a8ff6e-21d3-4c28-bcad-e323847985dc'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-11-28T01:50:59.095ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-11-28T01:50:59.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 42.06795ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-11-28T01:50:59.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 60.809665ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-11-28T01:50:59.568ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.622287299s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2202024-11-28T01:50:59.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 143.24973ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-28T01:50:59.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 222.741974ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-28T01:51:00.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 868.830394ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-28T01:51:01.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.401312291s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-28T01:51:02.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 581.846033ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-28T01:51:03.193ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.655123487s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2262024-11-28T01:51:03.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 904.81054ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-28T01:51:04.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.219427873s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-28T01:51:06.009ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/nexus.rs:527 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2292024-11-28T01:51:06.039ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2302024-11-28T01:51:06.039ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2312024-11-28T01:51:06.040ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2322024-11-28T01:51:06.041ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2332024-11-28T01:51:06.041ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2342024-11-28T01:51:06.041ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-11-28T01:51:06.041ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-28T01:51:06.041ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2372024-11-28T01:51:06.041ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2382024-11-28T01:51:06.041ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:60846
2392024-11-28T01:51:06.041ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2402024-11-28T01:51:06.229ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2412024-11-28T01:51:06.229ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2422024-11-28T01:51:06.229ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2432024-11-28T01:51:06.229ZINFOSledAgent (RSS): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2442024-11-28T01:51:06.229ZINFOSledAgent (RSS): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-28T01:51:06.229ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2462024-11-28T01:51:06.229ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-28T01:51:06.229ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-28T01:51:06.229ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-28T01:51:06.235ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2502024-11-28T01:51:06.235ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2512024-11-28T01:51:06.235ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2522024-11-28T01:51:06.471ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18123829972584498529 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2532024-11-28T01:51:06.471ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9942302142470360913 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2542024-11-28T01:51:06.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39485
2552024-11-28T01:51:06.499ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-28T01:51:06.499ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2572024-11-28T01:51:06.499ZINFOSledAgent (ServiceManager): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-28T01:51:06.499ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:188
2592024-11-28T01:51:06.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39485 req_id = e8ee48ef-3905-4be3-afcc-5902e6cfefad response_code = 200 uri = /inventory
2602024-11-28T01:51:06.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52825
2612024-11-28T01:51:06.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52825 req_id = dd37fb01-76ac-4ab9-a0d3-9117469d1067 response_code = 200 uri = /sled-role
2622024-11-28T01:51:06.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2632024-11-28T01:51:06.532ZINFOSledAgent (RSS): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-28T01:51:06.533ZINFOSledAgent (RSS): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2652024-11-28T01:51:06.533ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:982
2662024-11-28T01:51:06.565ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9043d06e-992f-416f-b46b-ae675222227c (physical_disk), pool_id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0ced3144-2963-4e3e-a1e1-20bb0aa5f263 (physical_disk), pool_id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: b7f50b23-3db9-4126-8a8d-177d6482dda7 (physical_disk), pool_id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: f917f840-f0de-4778-a870-a6a99fa569be (physical_disk), pool_id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 946d4efb-f6e6-4ed5-99f3-b87719030441 (physical_disk), pool_id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 952e55ca-6faf-4cf9-b470-852d620315de (physical_disk), pool_id: c9996824-866a-4451-99ce-f11f76d585ed (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: bc0f8097-a34b-4657-8a1c-797f662c20ce (physical_disk), pool_id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e53f3038-c247-454e-a047-6f68119572b0 (physical_disk), pool_id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ef7c0d60-f2a2-4f55-8f76-23553a2ccc30 (physical_disk), pool_id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:369 sled_address = [fd00:1122:3344:101::1]:12345
2672024-11-28T01:51:06.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61655
2682024-11-28T01:51:06.565ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2692024-11-28T01:51:06.565ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9043d06e-992f-416f-b46b-ae675222227c (physical_disk), pool_id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0ced3144-2963-4e3e-a1e1-20bb0aa5f263 (physical_disk), pool_id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: b7f50b23-3db9-4126-8a8d-177d6482dda7 (physical_disk), pool_id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: f917f840-f0de-4778-a870-a6a99fa569be (physical_disk), pool_id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 946d4efb-f6e6-4ed5-99f3-b87719030441 (physical_disk), pool_id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 952e55ca-6faf-4cf9-b470-852d620315de (physical_disk), pool_id: c9996824-866a-4451-99ce-f11f76d585ed (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: bc0f8097-a34b-4657-8a1c-797f662c20ce (physical_disk), pool_id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e53f3038-c247-454e-a047-6f68119572b0 (physical_disk), pool_id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ef7c0d60-f2a2-4f55-8f76-23553a2ccc30 (physical_disk), pool_id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2702024-11-28T01:51:06.565ZINFOSledAgent (StorageManager): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-28T01:51:06.565ZINFOSledAgent (StorageManager): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2722024-11-28T01:51:06.566ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2732024-11-28T01:51:06.566ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2742024-11-28T01:51:06.566ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2752024-11-28T01:51:06.566ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2762024-11-28T01:51:06.566ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2772024-11-28T01:51:06.697ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
2782024-11-28T01:51:06.705ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2792024-11-28T01:51:06.705ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool)
2802024-11-28T01:51:06.802ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }
2812024-11-28T01:51:06.810ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2822024-11-28T01:51:06.810ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2832024-11-28T01:51:06.810ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2842024-11-28T01:51:06.810ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2852024-11-28T01:51:06.810ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2862024-11-28T01:51:06.810ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-11-28T01:51:06.810ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2882024-11-28T01:51:06.846ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2892024-11-28T01:51:06.854ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone file = sled-storage/src/dataset.rs:303
2902024-11-28T01:51:07.022ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_89678a9e-6cf0-40f7-a395-8631085163d8 file = sled-storage/src/dataset.rs:389
2912024-11-28T01:51:07.030ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2922024-11-28T01:51:07.030ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2932024-11-28T01:51:07.030ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2942024-11-28T01:51:07.030ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2952024-11-28T01:51:07.030ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2962024-11-28T01:51:07.040ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2972024-11-28T01:51:07.040ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool)
2982024-11-28T01:51:07.131ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }
2992024-11-28T01:51:07.139ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3002024-11-28T01:51:07.139ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3012024-11-28T01:51:07.139ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3022024-11-28T01:51:07.139ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3032024-11-28T01:51:07.139ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3042024-11-28T01:51:07.139ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3052024-11-28T01:51:07.139ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3062024-11-28T01:51:07.143ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/probe_manager.rs:231 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
3072024-11-28T01:51:07.174ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3082024-11-28T01:51:07.182ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone file = sled-storage/src/dataset.rs:303
3092024-11-28T01:51:07.350ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69 file = sled-storage/src/dataset.rs:389
3102024-11-28T01:51:07.358ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3112024-11-28T01:51:07.358ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3122024-11-28T01:51:07.358ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3132024-11-28T01:51:07.358ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3142024-11-28T01:51:07.358ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3152024-11-28T01:51:07.367ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3162024-11-28T01:51:07.367ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool)
3172024-11-28T01:51:07.459ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }
3182024-11-28T01:51:07.467ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3192024-11-28T01:51:07.467ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3202024-11-28T01:51:07.467ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3212024-11-28T01:51:07.467ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3222024-11-28T01:51:07.467ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3232024-11-28T01:51:07.467ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-11-28T01:51:07.467ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3252024-11-28T01:51:07.503ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3262024-11-28T01:51:07.510ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/zone file = sled-storage/src/dataset.rs:303
3272024-11-28T01:51:07.680ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_830b5e11-e6e4-4144-bc16-2396db6d872e file = sled-storage/src/dataset.rs:389
3282024-11-28T01:51:07.688ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3292024-11-28T01:51:07.688ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3302024-11-28T01:51:07.688ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3312024-11-28T01:51:07.688ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3322024-11-28T01:51:07.688ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3332024-11-28T01:51:07.697ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3342024-11-28T01:51:07.697ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool)
3352024-11-28T01:51:07.789ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }
3362024-11-28T01:51:07.797ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3372024-11-28T01:51:07.797ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3382024-11-28T01:51:07.797ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3392024-11-28T01:51:07.797ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3402024-11-28T01:51:07.797ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3412024-11-28T01:51:07.797ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3422024-11-28T01:51:07.797ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3432024-11-28T01:51:07.832ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3442024-11-28T01:51:07.841ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/zone file = sled-storage/src/dataset.rs:303
3452024-11-28T01:51:08.015ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8 file = sled-storage/src/dataset.rs:389
3462024-11-28T01:51:08.024ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3472024-11-28T01:51:08.024ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3482024-11-28T01:51:08.024ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3492024-11-28T01:51:08.024ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3502024-11-28T01:51:08.024ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3512024-11-28T01:51:08.033ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3522024-11-28T01:51:08.033ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool)
3532024-11-28T01:51:08.133ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }
3542024-11-28T01:51:08.141ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3552024-11-28T01:51:08.141ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3562024-11-28T01:51:08.141ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3572024-11-28T01:51:08.142ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3582024-11-28T01:51:08.142ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3592024-11-28T01:51:08.142ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3602024-11-28T01:51:08.142ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3612024-11-28T01:51:08.145ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/probe_manager.rs:231 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
3622024-11-28T01:51:08.179ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3632024-11-28T01:51:08.185ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone file = sled-storage/src/dataset.rs:303
3642024-11-28T01:51:08.360ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be file = sled-storage/src/dataset.rs:389
3652024-11-28T01:51:08.367ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3662024-11-28T01:51:08.367ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3672024-11-28T01:51:08.367ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3682024-11-28T01:51:08.367ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3692024-11-28T01:51:08.367ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3702024-11-28T01:51:08.378ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3712024-11-28T01:51:08.378ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c9996824-866a-4451-99ce-f11f76d585ed (zpool)
3722024-11-28T01:51:08.477ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }
3732024-11-28T01:51:08.485ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3742024-11-28T01:51:08.485ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3752024-11-28T01:51:08.485ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3762024-11-28T01:51:08.485ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3772024-11-28T01:51:08.485ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3782024-11-28T01:51:08.485ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3792024-11-28T01:51:08.485ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3802024-11-28T01:51:08.520ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3812024-11-28T01:51:08.528ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c9996824-866a-4451-99ce-f11f76d585ed/crypt/zone file = sled-storage/src/dataset.rs:303
3822024-11-28T01:51:08.700ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c9996824-866a-4451-99ce-f11f76d585ed file = sled-storage/src/dataset.rs:389
3832024-11-28T01:51:08.708ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3842024-11-28T01:51:08.708ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3852024-11-28T01:51:08.708ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3862024-11-28T01:51:08.708ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3872024-11-28T01:51:08.708ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3882024-11-28T01:51:08.719ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3892024-11-28T01:51:08.719ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool)
3902024-11-28T01:51:08.814ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }
3912024-11-28T01:51:08.822ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3922024-11-28T01:51:08.822ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3932024-11-28T01:51:08.822ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3942024-11-28T01:51:08.823ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3952024-11-28T01:51:08.823ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3962024-11-28T01:51:08.823ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3972024-11-28T01:51:08.823ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3982024-11-28T01:51:08.863ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3992024-11-28T01:51:08.873ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa/crypt/zone file = sled-storage/src/dataset.rs:303
4002024-11-28T01:51:09.046ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa file = sled-storage/src/dataset.rs:389
4012024-11-28T01:51:09.055ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4022024-11-28T01:51:09.055ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4032024-11-28T01:51:09.055ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4042024-11-28T01:51:09.055ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4052024-11-28T01:51:09.055ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4062024-11-28T01:51:09.066ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4072024-11-28T01:51:09.066ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 60dc1266-4525-4b36-849d-835d2a02f170 (zpool)
4082024-11-28T01:51:09.160ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }
4092024-11-28T01:51:09.168ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4102024-11-28T01:51:09.168ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4112024-11-28T01:51:09.168ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4122024-11-28T01:51:09.168ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4132024-11-28T01:51:09.168ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4142024-11-28T01:51:09.168ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4152024-11-28T01:51:09.168ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4162024-11-28T01:51:09.172ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/probe_manager.rs:231 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4172024-11-28T01:51:09.206ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4182024-11-28T01:51:09.214ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_60dc1266-4525-4b36-849d-835d2a02f170/crypt/zone file = sled-storage/src/dataset.rs:303
4192024-11-28T01:51:09.390ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_60dc1266-4525-4b36-849d-835d2a02f170 file = sled-storage/src/dataset.rs:389
4202024-11-28T01:51:09.398ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4212024-11-28T01:51:09.398ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4222024-11-28T01:51:09.398ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4232024-11-28T01:51:09.398ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4242024-11-28T01:51:09.398ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4252024-11-28T01:51:09.408ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4262024-11-28T01:51:09.408ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool)
4272024-11-28T01:51:09.505ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }
4282024-11-28T01:51:09.513ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4292024-11-28T01:51:09.514ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4302024-11-28T01:51:09.514ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4312024-11-28T01:51:09.514ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4322024-11-28T01:51:09.514ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4332024-11-28T01:51:09.514ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4342024-11-28T01:51:09.514ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4352024-11-28T01:51:09.551ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4362024-11-28T01:51:09.559ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/zone file = sled-storage/src/dataset.rs:303
4372024-11-28T01:51:09.735ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 file = sled-storage/src/dataset.rs:389
4382024-11-28T01:51:09.743ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4392024-11-28T01:51:09.743ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4402024-11-28T01:51:09.743ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4412024-11-28T01:51:09.743ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f1d962-0f92-42e6-af9d-3f59d408bbbd (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b10d5a12-f0d1-4561-881b-d6c57310fb97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4422024-11-28T01:51:09.743ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4432024-11-28T01:51:09.743ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4442024-11-28T01:51:09.743ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4452024-11-28T01:51:09.744ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4462024-11-28T01:51:09.744ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4472024-11-28T01:51:09.744ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4482024-11-28T01:51:09.744ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4492024-11-28T01:51:09.744ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4502024-11-28T01:51:09.744ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4512024-11-28T01:51:09.744ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4522024-11-28T01:51:09.744ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4532024-11-28T01:51:09.744ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4542024-11-28T01:51:09.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3178465 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61655 req_id = dc348519-72cc-4047-8629-bb8b778cb96c response_code = 200 uri = /omicron-physical-disks
4552024-11-28T01:51:09.775ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0109f377-25c7-4458-9a38-4e90475ab635 (dataset): DatasetConfig { id: 0109f377-25c7-4458-9a38-4e90475ab635 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 060227e2-9baf-4303-a775-b91871558a05 (dataset): DatasetConfig { id: 060227e2-9baf-4303-a775-b91871558a05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 136091e1-ea5a-48c6-82a5-a3840a7bd210 (dataset): DatasetConfig { id: 136091e1-ea5a-48c6-82a5-a3840a7bd210 (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1623c57c-9195-417f-a86f-12a5d3b2d5a7 (dataset): DatasetConfig { id: 1623c57c-9195-417f-a86f-12a5d3b2d5a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1fe4409a-5580-4a8f-8d4d-ba3df3efa76d (dataset): DatasetConfig { id: 1fe4409a-5580-4a8f-8d4d-ba3df3efa76d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 207d93cb-26dd-40be-81fd-1b3660276876 (dataset): DatasetConfig { id: 207d93cb-26dd-40be-81fd-1b3660276876 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2227cd8a-ab5d-4409-8ca6-40c02ea2f9c3 (dataset): DatasetConfig { id: 2227cd8a-ab5d-4409-8ca6-40c02ea2f9c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 255d1737-3c17-40b8-91f1-4191bb3ff30c (dataset): DatasetConfig { id: 255d1737-3c17-40b8-91f1-4191bb3ff30c (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25a7abcb-ac1c-45a2-b1bf-a1929339ec03 (dataset): DatasetConfig { id: 25a7abcb-ac1c-45a2-b1bf-a1929339ec03 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2df35927-b7cd-4b83-8fdf-5c279ec19a3d (dataset): DatasetConfig { id: 2df35927-b7cd-4b83-8fdf-5c279ec19a3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30bad247-1d7d-460f-8066-0534f77acb6a (dataset): DatasetConfig { id: 30bad247-1d7d-460f-8066-0534f77acb6a (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 378de249-e1cf-4145-82be-0d6a8f88cef7 (dataset): DatasetConfig { id: 378de249-e1cf-4145-82be-0d6a8f88cef7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 394f419f-f0cc-47c1-97f1-8a4b05ae2309 (dataset): DatasetConfig { id: 394f419f-f0cc-47c1-97f1-8a4b05ae2309 (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3994fcaf-852a-4725-bfca-d943ef3ffcaf (dataset): DatasetConfig { id: 3994fcaf-852a-4725-bfca-d943ef3ffcaf (dataset), name: DatasetName { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3b8c7b28-a7a9-4adf-be36-dd39b88ed744 (dataset): DatasetConfig { id: 3b8c7b28-a7a9-4adf-be36-dd39b88ed744 (dataset), name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41f1f139-21be-4e41-b559-a196dcde28c4 (dataset): DatasetConfig { id: 41f1f139-21be-4e41-b559-a196dcde28c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45429602-ae03-44b4-b357-cd5c0b3107af (dataset): DatasetConfig { id: 45429602-ae03-44b4-b357-cd5c0b3107af (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4680a1f7-6d02-4ac5-b7e3-c827e239478d (dataset): DatasetConfig { id: 4680a1f7-6d02-4ac5-b7e3-c827e239478d (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4dc66321-b731-4170-967b-82b0acfc7453 (dataset): DatasetConfig { id: 4dc66321-b731-4170-967b-82b0acfc7453 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53170c1f-dda5-4e7d-8bdd-96ef402d9433 (dataset): DatasetConfig { id: 53170c1f-dda5-4e7d-8bdd-96ef402d9433 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54f3e5e0-feaf-49f1-8320-24ae853f2f4e (dataset): DatasetConfig { id: 54f3e5e0-feaf-49f1-8320-24ae853f2f4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cf6528c-3071-4c93-8ccd-e8fef9f88d9b (dataset): DatasetConfig { id: 5cf6528c-3071-4c93-8ccd-e8fef9f88d9b (dataset), name: DatasetName { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6272ee56-8904-4259-9a7b-ed861f3cb3a7 (dataset): DatasetConfig { id: 6272ee56-8904-4259-9a7b-ed861f3cb3a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 632bb454-4ba8-4610-b22a-12e46ea825c3 (dataset): DatasetConfig { id: 632bb454-4ba8-4610-b22a-12e46ea825c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6524b2f8-6ae1-4bc3-97b5-f49ab4e34592 (dataset): DatasetConfig { id: 6524b2f8-6ae1-4bc3-97b5-f49ab4e34592 (dataset), name: DatasetName { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66046abf-f8f1-4e66-98cb-5bbbfb0fed19 (dataset): DatasetConfig { id: 66046abf-f8f1-4e66-98cb-5bbbfb0fed19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69356172-4e08-497b-a980-008eaff3086c (dataset): DatasetConfig { id: 69356172-4e08-497b-a980-008eaff3086c (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f02e004-9500-4140-a254-f69890564da3 (dataset): DatasetConfig { id: 6f02e004-9500-4140-a254-f69890564da3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7348fba1-a249-418c-a851-c9d4afe89be5 (dataset): DatasetConfig { id: 7348fba1-a249-418c-a851-c9d4afe89be5 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78542394-8945-470e-bd58-8702cea66648 (dataset): DatasetConfig { id: 78542394-8945-470e-bd58-8702cea66648 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a51e59d-b189-43db-a72f-94262052995e (dataset): DatasetConfig { id: 7a51e59d-b189-43db-a72f-94262052995e (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cf44245-3805-4a96-ba7f-5b883d026eb4 (dataset): DatasetConfig { id: 7cf44245-3805-4a96-ba7f-5b883d026eb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8af4a82f-1ada-4082-95e9-1f5f4a84f23b (dataset): DatasetConfig { id: 8af4a82f-1ada-4082-95e9-1f5f4a84f23b (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ba75aa1-4bcf-4fea-ad95-bcb9ce8ac0fb (dataset): DatasetConfig { id: 8ba75aa1-4bcf-4fea-ad95-bcb9ce8ac0fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e023ba5-5376-4666-a4af-3cd65434f024 (dataset): DatasetConfig { id: 8e023ba5-5376-4666-a4af-3cd65434f024 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91b34eba-819b-4807-a20b-4ae9b4cac3cb (dataset): DatasetConfig { id: 91b34eba-819b-4807-a20b-4ae9b4cac3cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91e49ad8-d3f4-4c2a-af04-7a2d2d94b13a (dataset): DatasetConfig { id: 91e49ad8-d3f4-4c2a-af04-7a2d2d94b13a (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9433d1c9-4646-45f7-9445-9e78c14011bf (dataset): DatasetConfig { id: 9433d1c9-4646-45f7-9445-9e78c14011bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d899165-b23d-4a27-9502-d14ceb58e2db (dataset): DatasetConfig { id: 9d899165-b23d-4a27-9502-d14ceb58e2db (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fc3ede4-a07f-4d17-8b75-f147372128d6 (dataset): DatasetConfig { id: 9fc3ede4-a07f-4d17-8b75-f147372128d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a10c7fda-f736-48ed-b90a-e04312db3bdb (dataset): DatasetConfig { id: a10c7fda-f736-48ed-b90a-e04312db3bdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a18acc2f-43fe-4ac6-822b-537964f3a041 (dataset): DatasetConfig { id: a18acc2f-43fe-4ac6-822b-537964f3a041 (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, af6fffa4-f6b3-4c95-8d3b-750325aafd51 (dataset): DatasetConfig { id: af6fffa4-f6b3-4c95-8d3b-750325aafd51 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b09b5461-428f-4a08-a8f0-2f65d92e3e16 (dataset): DatasetConfig { id: b09b5461-428f-4a08-a8f0-2f65d92e3e16 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b452f052-b964-48e8-b178-9db37dc504f7 (dataset): DatasetConfig { id: b452f052-b964-48e8-b178-9db37dc504f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5a45393-9f71-4799-838d-3d4093b1db79 (dataset): DatasetConfig { id: b5a45393-9f71-4799-838d-3d4093b1db79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b95bf91f-40e6-4a64-832c-8d11ccf032d8 (dataset): DatasetConfig { id: b95bf91f-40e6-4a64-832c-8d11ccf032d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd50d323-152a-4b2e-8fce-1ddf80265ef8 (dataset): DatasetConfig { id: bd50d323-152a-4b2e-8fce-1ddf80265ef8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c280f4b2-bfd6-4638-b928-1c9f880519af (dataset): DatasetConfig { id: c280f4b2-bfd6-4638-b928-1c9f880519af (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4c7ccfb-f88b-46eb-bf8c-e721eeb18532 (dataset): DatasetConfig { id: c4c7ccfb-f88b-46eb-bf8c-e721eeb18532 (dataset), name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c91ba30a-741d-409d-9258-bcbf82111ea3 (dataset): DatasetConfig { id: c91ba30a-741d-409d-9258-bcbf82111ea3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cb64249c-752b-4281-ab05-719487bb7bb7 (dataset): DatasetConfig { id: cb64249c-752b-4281-ab05-719487bb7bb7 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd4f7867-ec60-49cd-9ce7-1ef7bee06df2 (dataset): DatasetConfig { id: cd4f7867-ec60-49cd-9ce7-1ef7bee06df2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d20821db-1e9d-430c-80a4-3c44488a5bfc (dataset): DatasetConfig { id: d20821db-1e9d-430c-80a4-3c44488a5bfc (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d312b1a6-cd46-4d6d-8549-5e57631f049f (dataset): DatasetConfig { id: d312b1a6-cd46-4d6d-8549-5e57631f049f (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3b0bbd5-2fa5-44ed-9341-ca8a8ba79303 (dataset): DatasetConfig { id: e3b0bbd5-2fa5-44ed-9341-ca8a8ba79303 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e65b7424-2191-4bd4-92e4-9032c33bb36e (dataset): DatasetConfig { id: e65b7424-2191-4bd4-92e4-9032c33bb36e (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8a0945b-802e-4e84-a60c-63a077d90565 (dataset): DatasetConfig { id: e8a0945b-802e-4e84-a60c-63a077d90565 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb2eff7b-99cd-48a2-8035-a2242733bf3a (dataset): DatasetConfig { id: eb2eff7b-99cd-48a2-8035-a2242733bf3a (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee548cd8-d92f-4d70-a6cc-f99f40099671 (dataset): DatasetConfig { id: ee548cd8-d92f-4d70-a6cc-f99f40099671 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f094a7ce-fb16-4125-a91f-947ff10c0ea4 (dataset): DatasetConfig { id: f094a7ce-fb16-4125-a91f-947ff10c0ea4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f126e2ad-bdc4-4d22-8535-e73d6787c825 (dataset): DatasetConfig { id: f126e2ad-bdc4-4d22-8535-e73d6787c825 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1982b52-631e-4130-b67a-80a306b440ab (dataset): DatasetConfig { id: f1982b52-631e-4130-b67a-80a306b440ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f89707a1-87d6-4331-a1e3-2bfd01e8eb81 (dataset): DatasetConfig { id: f89707a1-87d6-4331-a1e3-2bfd01e8eb81 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fcc756b0-97a3-4257-ae66-698f9991bf93 (dataset): DatasetConfig { id: fcc756b0-97a3-4257-ae66-698f9991bf93 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feb97627-e06e-4344-94c0-cdfae0a5487e (dataset): DatasetConfig { id: feb97627-e06e-4344-94c0-cdfae0a5487e (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:444 sled_address = [fd00:1122:3344:101::1]:12345
4562024-11-28T01:51:09.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41014
4572024-11-28T01:51:09.776ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4582024-11-28T01:51:09.776ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0109f377-25c7-4458-9a38-4e90475ab635 (dataset): DatasetConfig { id: 0109f377-25c7-4458-9a38-4e90475ab635 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 060227e2-9baf-4303-a775-b91871558a05 (dataset): DatasetConfig { id: 060227e2-9baf-4303-a775-b91871558a05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 136091e1-ea5a-48c6-82a5-a3840a7bd210 (dataset): DatasetConfig { id: 136091e1-ea5a-48c6-82a5-a3840a7bd210 (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1623c57c-9195-417f-a86f-12a5d3b2d5a7 (dataset): DatasetConfig { id: 1623c57c-9195-417f-a86f-12a5d3b2d5a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1fe4409a-5580-4a8f-8d4d-ba3df3efa76d (dataset): DatasetConfig { id: 1fe4409a-5580-4a8f-8d4d-ba3df3efa76d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 207d93cb-26dd-40be-81fd-1b3660276876 (dataset): DatasetConfig { id: 207d93cb-26dd-40be-81fd-1b3660276876 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2227cd8a-ab5d-4409-8ca6-40c02ea2f9c3 (dataset): DatasetConfig { id: 2227cd8a-ab5d-4409-8ca6-40c02ea2f9c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 255d1737-3c17-40b8-91f1-4191bb3ff30c (dataset): DatasetConfig { id: 255d1737-3c17-40b8-91f1-4191bb3ff30c (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25a7abcb-ac1c-45a2-b1bf-a1929339ec03 (dataset): DatasetConfig { id: 25a7abcb-ac1c-45a2-b1bf-a1929339ec03 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2df35927-b7cd-4b83-8fdf-5c279ec19a3d (dataset): DatasetConfig { id: 2df35927-b7cd-4b83-8fdf-5c279ec19a3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30bad247-1d7d-460f-8066-0534f77acb6a (dataset): DatasetConfig { id: 30bad247-1d7d-460f-8066-0534f77acb6a (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 378de249-e1cf-4145-82be-0d6a8f88cef7 (dataset): DatasetConfig { id: 378de249-e1cf-4145-82be-0d6a8f88cef7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 394f419f-f0cc-47c1-97f1-8a4b05ae2309 (dataset): DatasetConfig { id: 394f419f-f0cc-47c1-97f1-8a4b05ae2309 (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3994fcaf-852a-4725-bfca-d943ef3ffcaf (dataset): DatasetConfig { id: 3994fcaf-852a-4725-bfca-d943ef3ffcaf (dataset), name: DatasetName { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3b8c7b28-a7a9-4adf-be36-dd39b88ed744 (dataset): DatasetConfig { id: 3b8c7b28-a7a9-4adf-be36-dd39b88ed744 (dataset), name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41f1f139-21be-4e41-b559-a196dcde28c4 (dataset): DatasetConfig { id: 41f1f139-21be-4e41-b559-a196dcde28c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45429602-ae03-44b4-b357-cd5c0b3107af (dataset): DatasetConfig { id: 45429602-ae03-44b4-b357-cd5c0b3107af (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4680a1f7-6d02-4ac5-b7e3-c827e239478d (dataset): DatasetConfig { id: 4680a1f7-6d02-4ac5-b7e3-c827e239478d (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4dc66321-b731-4170-967b-82b0acfc7453 (dataset): DatasetConfig { id: 4dc66321-b731-4170-967b-82b0acfc7453 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53170c1f-dda5-4e7d-8bdd-96ef402d9433 (dataset): DatasetConfig { id: 53170c1f-dda5-4e7d-8bdd-96ef402d9433 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54f3e5e0-feaf-49f1-8320-24ae853f2f4e (dataset): DatasetConfig { id: 54f3e5e0-feaf-49f1-8320-24ae853f2f4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cf6528c-3071-4c93-8ccd-e8fef9f88d9b (dataset): DatasetConfig { id: 5cf6528c-3071-4c93-8ccd-e8fef9f88d9b (dataset), name: DatasetName { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6272ee56-8904-4259-9a7b-ed861f3cb3a7 (dataset): DatasetConfig { id: 6272ee56-8904-4259-9a7b-ed861f3cb3a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 632bb454-4ba8-4610-b22a-12e46ea825c3 (dataset): DatasetConfig { id: 632bb454-4ba8-4610-b22a-12e46ea825c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6524b2f8-6ae1-4bc3-97b5-f49ab4e34592 (dataset): DatasetConfig { id: 6524b2f8-6ae1-4bc3-97b5-f49ab4e34592 (dataset), name: DatasetName { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66046abf-f8f1-4e66-98cb-5bbbfb0fed19 (dataset): DatasetConfig { id: 66046abf-f8f1-4e66-98cb-5bbbfb0fed19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69356172-4e08-497b-a980-008eaff3086c (dataset): DatasetConfig { id: 69356172-4e08-497b-a980-008eaff3086c (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f02e004-9500-4140-a254-f69890564da3 (dataset): DatasetConfig { id: 6f02e004-9500-4140-a254-f69890564da3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7348fba1-a249-418c-a851-c9d4afe89be5 (dataset): DatasetConfig { id: 7348fba1-a249-418c-a851-c9d4afe89be5 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78542394-8945-470e-bd58-8702cea66648 (dataset): DatasetConfig { id: 78542394-8945-470e-bd58-8702cea66648 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a51e59d-b189-43db-a72f-94262052995e (dataset): DatasetConfig { id: 7a51e59d-b189-43db-a72f-94262052995e (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cf44245-3805-4a96-ba7f-5b883d026eb4 (dataset): DatasetConfig { id: 7cf44245-3805-4a96-ba7f-5b883d026eb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8af4a82f-1ada-4082-95e9-1f5f4a84f23b (dataset): DatasetConfig { id: 8af4a82f-1ada-4082-95e9-1f5f4a84f23b (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ba75aa1-4bcf-4fea-ad95-bcb9ce8ac0fb (dataset): DatasetConfig { id: 8ba75aa1-4bcf-4fea-ad95-bcb9ce8ac0fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e023ba5-5376-4666-a4af-3cd65434f024 (dataset): DatasetConfig { id: 8e023ba5-5376-4666-a4af-3cd65434f024 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91b34eba-819b-4807-a20b-4ae9b4cac3cb (dataset): DatasetConfig { id: 91b34eba-819b-4807-a20b-4ae9b4cac3cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91e49ad8-d3f4-4c2a-af04-7a2d2d94b13a (dataset): DatasetConfig { id: 91e49ad8-d3f4-4c2a-af04-7a2d2d94b13a (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9433d1c9-4646-45f7-9445-9e78c14011bf (dataset): DatasetConfig { id: 9433d1c9-4646-45f7-9445-9e78c14011bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d899165-b23d-4a27-9502-d14ceb58e2db (dataset): DatasetConfig { id: 9d899165-b23d-4a27-9502-d14ceb58e2db (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fc3ede4-a07f-4d17-8b75-f147372128d6 (dataset): DatasetConfig { id: 9fc3ede4-a07f-4d17-8b75-f147372128d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a10c7fda-f736-48ed-b90a-e04312db3bdb (dataset): DatasetConfig { id: a10c7fda-f736-48ed-b90a-e04312db3bdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a18acc2f-43fe-4ac6-822b-537964f3a041 (dataset): DatasetConfig { id: a18acc2f-43fe-4ac6-822b-537964f3a041 (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, af6fffa4-f6b3-4c95-8d3b-750325aafd51 (dataset): DatasetConfig { id: af6fffa4-f6b3-4c95-8d3b-750325aafd51 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b09b5461-428f-4a08-a8f0-2f65d92e3e16 (dataset): DatasetConfig { id: b09b5461-428f-4a08-a8f0-2f65d92e3e16 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b452f052-b964-48e8-b178-9db37dc504f7 (dataset): DatasetConfig { id: b452f052-b964-48e8-b178-9db37dc504f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5a45393-9f71-4799-838d-3d4093b1db79 (dataset): DatasetConfig { id: b5a45393-9f71-4799-838d-3d4093b1db79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b95bf91f-40e6-4a64-832c-8d11ccf032d8 (dataset): DatasetConfig { id: b95bf91f-40e6-4a64-832c-8d11ccf032d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd50d323-152a-4b2e-8fce-1ddf80265ef8 (dataset): DatasetConfig { id: bd50d323-152a-4b2e-8fce-1ddf80265ef8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c280f4b2-bfd6-4638-b928-1c9f880519af (dataset): DatasetConfig { id: c280f4b2-bfd6-4638-b928-1c9f880519af (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4c7ccfb-f88b-46eb-bf8c-e721eeb18532 (dataset): DatasetConfig { id: c4c7ccfb-f88b-46eb-bf8c-e721eeb18532 (dataset), name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c91ba30a-741d-409d-9258-bcbf82111ea3 (dataset): DatasetConfig { id: c91ba30a-741d-409d-9258-bcbf82111ea3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cb64249c-752b-4281-ab05-719487bb7bb7 (dataset): DatasetConfig { id: cb64249c-752b-4281-ab05-719487bb7bb7 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd4f7867-ec60-49cd-9ce7-1ef7bee06df2 (dataset): DatasetConfig { id: cd4f7867-ec60-49cd-9ce7-1ef7bee06df2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d20821db-1e9d-430c-80a4-3c44488a5bfc (dataset): DatasetConfig { id: d20821db-1e9d-430c-80a4-3c44488a5bfc (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d312b1a6-cd46-4d6d-8549-5e57631f049f (dataset): DatasetConfig { id: d312b1a6-cd46-4d6d-8549-5e57631f049f (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3b0bbd5-2fa5-44ed-9341-ca8a8ba79303 (dataset): DatasetConfig { id: e3b0bbd5-2fa5-44ed-9341-ca8a8ba79303 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e65b7424-2191-4bd4-92e4-9032c33bb36e (dataset): DatasetConfig { id: e65b7424-2191-4bd4-92e4-9032c33bb36e (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8a0945b-802e-4e84-a60c-63a077d90565 (dataset): DatasetConfig { id: e8a0945b-802e-4e84-a60c-63a077d90565 (dataset), name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb2eff7b-99cd-48a2-8035-a2242733bf3a (dataset): DatasetConfig { id: eb2eff7b-99cd-48a2-8035-a2242733bf3a (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee548cd8-d92f-4d70-a6cc-f99f40099671 (dataset): DatasetConfig { id: ee548cd8-d92f-4d70-a6cc-f99f40099671 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f094a7ce-fb16-4125-a91f-947ff10c0ea4 (dataset): DatasetConfig { id: f094a7ce-fb16-4125-a91f-947ff10c0ea4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f126e2ad-bdc4-4d22-8535-e73d6787c825 (dataset): DatasetConfig { id: f126e2ad-bdc4-4d22-8535-e73d6787c825 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1982b52-631e-4130-b67a-80a306b440ab (dataset): DatasetConfig { id: f1982b52-631e-4130-b67a-80a306b440ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f89707a1-87d6-4331-a1e3-2bfd01e8eb81 (dataset): DatasetConfig { id: f89707a1-87d6-4331-a1e3-2bfd01e8eb81 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fcc756b0-97a3-4257-ae66-698f9991bf93 (dataset): DatasetConfig { id: fcc756b0-97a3-4257-ae66-698f9991bf93 (dataset), name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feb97627-e06e-4344-94c0-cdfae0a5487e (dataset): DatasetConfig { id: feb97627-e06e-4344-94c0-cdfae0a5487e (dataset), name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4592024-11-28T01:51:09.776ZINFOSledAgent (StorageManager): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4602024-11-28T01:51:09.776ZINFOSledAgent (StorageManager): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4612024-11-28T01:51:09.776ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4622024-11-28T01:51:09.776ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4632024-11-28T01:51:09.776ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/debug"), full_name: "oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/debug" } file = sled-storage/src/manager.rs:1331
4642024-11-28T01:51:09.844ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-11-28T01:51:09.844ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/zone/oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958"), full_name: "oxp_830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/zone/oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958" } file = sled-storage/src/manager.rs:1331
4662024-11-28T01:51:09.944ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-11-28T01:51:09.944ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crucible" } file = sled-storage/src/manager.rs:1331
4682024-11-28T01:51:10.031ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-11-28T01:51:10.031ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/zone/oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9"), full_name: "oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/zone/oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9" } file = sled-storage/src/manager.rs:1331
4702024-11-28T01:51:10.130ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-11-28T01:51:10.130ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4722024-11-28T01:51:10.175ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/probe_manager.rs:231 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4732024-11-28T01:51:10.223ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-11-28T01:51:10.223ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/zone"), full_name: "oxp_830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/zone" } file = sled-storage/src/manager.rs:1331
4752024-11-28T01:51:10.292ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-11-28T01:51:10.292ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone/oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone/oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b" } file = sled-storage/src/manager.rs:1331
4772024-11-28T01:51:10.392ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-28T01:51:10.392ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/zone/oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5"), full_name: "oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/zone/oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5" } file = sled-storage/src/manager.rs:1331
4792024-11-28T01:51:10.490ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-11-28T01:51:10.490ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/debug"), full_name: "oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/debug" } file = sled-storage/src/manager.rs:1331
4812024-11-28T01:51:10.557ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-11-28T01:51:10.557ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4832024-11-28T01:51:10.648ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-11-28T01:51:10.648ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone/oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026"), full_name: "oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone/oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026" } file = sled-storage/src/manager.rs:1331
4852024-11-28T01:51:10.746ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-11-28T01:51:10.746ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b75d1286-8ea6-47b2-8976-e2951a13a6fa/crypt/zone/oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0"), full_name: "oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa/crypt/zone/oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0" } file = sled-storage/src/manager.rs:1331
4872024-11-28T01:51:10.847ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-11-28T01:51:10.847ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/zone"), full_name: "oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/zone" } file = sled-storage/src/manager.rs:1331
4892024-11-28T01:51:10.915ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902024-11-28T01:51:10.915ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b75d1286-8ea6-47b2-8976-e2951a13a6fa/crypt/debug"), full_name: "oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa/crypt/debug" } file = sled-storage/src/manager.rs:1331
4912024-11-28T01:51:10.984ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922024-11-28T01:51:10.984ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c9996824-866a-4451-99ce-f11f76d585ed/crypt/zone/oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f"), full_name: "oxp_c9996824-866a-4451-99ce-f11f76d585ed/crypt/zone/oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f" } file = sled-storage/src/manager.rs:1331
4932024-11-28T01:51:11.080ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4942024-11-28T01:51:11.080ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/zone"), full_name: "oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/zone" } file = sled-storage/src/manager.rs:1331
4952024-11-28T01:51:11.144ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4962024-11-28T01:51:11.144ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_60dc1266-4525-4b36-849d-835d2a02f170/crucible" } file = sled-storage/src/manager.rs:1331
4972024-11-28T01:51:11.178ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/probe_manager.rs:231 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
4982024-11-28T01:51:11.232ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-11-28T01:51:11.232ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/60dc1266-4525-4b36-849d-835d2a02f170/crypt/zone"), full_name: "oxp_60dc1266-4525-4b36-849d-835d2a02f170/crypt/zone" } file = sled-storage/src/manager.rs:1331
5002024-11-28T01:51:11.296ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-11-28T01:51:11.296ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone/oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone/oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133" } file = sled-storage/src/manager.rs:1331
5022024-11-28T01:51:11.393ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-11-28T01:51:11.393ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/zone/oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f"), full_name: "oxp_830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/zone/oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f" } file = sled-storage/src/manager.rs:1331
5042024-11-28T01:51:11.492ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-11-28T01:51:11.492ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/zone/oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5"), full_name: "oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/zone/oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5" } file = sled-storage/src/manager.rs:1331
5062024-11-28T01:51:11.588ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-11-28T01:51:11.588ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b75d1286-8ea6-47b2-8976-e2951a13a6fa/crypt/zone"), full_name: "oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa/crypt/zone" } file = sled-storage/src/manager.rs:1331
5082024-11-28T01:51:11.655ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-11-28T01:51:11.655ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c9996824-866a-4451-99ce-f11f76d585ed/crypt/zone"), full_name: "oxp_c9996824-866a-4451-99ce-f11f76d585ed/crypt/zone" } file = sled-storage/src/manager.rs:1331
5102024-11-28T01:51:11.730ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-11-28T01:51:11.730ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone/oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone/oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905" } file = sled-storage/src/manager.rs:1331
5122024-11-28T01:51:11.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-11-28T01:51:11.829ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa/crucible" } file = sled-storage/src/manager.rs:1331
5142024-11-28T01:51:11.913ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-11-28T01:51:11.913ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/60dc1266-4525-4b36-849d-835d2a02f170/crypt/zone/oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17"), full_name: "oxp_60dc1266-4525-4b36-849d-835d2a02f170/crypt/zone/oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17" } file = sled-storage/src/manager.rs:1331
5162024-11-28T01:51:12.013ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172024-11-28T01:51:12.013ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone/oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf"), full_name: "oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone/oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf" } file = sled-storage/src/manager.rs:1331
5182024-11-28T01:51:12.113ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5192024-11-28T01:51:12.113ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/zone/oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178"), full_name: "oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/zone/oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178" } file = sled-storage/src/manager.rs:1331
5202024-11-28T01:51:12.182ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/probe_manager.rs:231 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
5212024-11-28T01:51:12.213ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-28T01:51:12.213ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone"), full_name: "oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone" } file = sled-storage/src/manager.rs:1331
5232024-11-28T01:51:12.279ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-11-28T01:51:12.279ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crucible" } file = sled-storage/src/manager.rs:1331
5252024-11-28T01:51:12.366ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-11-28T01:51:12.366ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone/oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1"), full_name: "oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone/oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1" } file = sled-storage/src/manager.rs:1331
5272024-11-28T01:51:12.464ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-11-28T01:51:12.464ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone" } file = sled-storage/src/manager.rs:1331
5292024-11-28T01:51:12.531ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-11-28T01:51:12.531ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone/oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone/oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8" } file = sled-storage/src/manager.rs:1331
5312024-11-28T01:51:12.629ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-11-28T01:51:12.629ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone/oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85"), full_name: "oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone/oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85" } file = sled-storage/src/manager.rs:1331
5332024-11-28T01:51:12.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-11-28T01:51:12.726ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5352024-11-28T01:51:12.815ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-11-28T01:51:12.815ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone/oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/zone/oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f" } file = sled-storage/src/manager.rs:1331
5372024-11-28T01:51:12.916ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-11-28T01:51:12.916ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5392024-11-28T01:51:13.005ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-11-28T01:51:13.005ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8/crucible" } file = sled-storage/src/manager.rs:1331
5412024-11-28T01:51:13.092ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422024-11-28T01:51:13.093ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5432024-11-28T01:51:13.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5442024-11-28T01:51:13.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c9996824-866a-4451-99ce-f11f76d585ed/crucible" } file = sled-storage/src/manager.rs:1331
5452024-11-28T01:51:13.185ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/probe_manager.rs:231 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
5462024-11-28T01:51:13.269ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-11-28T01:51:13.269ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crucible" } file = sled-storage/src/manager.rs:1331
5482024-11-28T01:51:13.354ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-11-28T01:51:13.354ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/debug"), full_name: "oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/debug" } file = sled-storage/src/manager.rs:1331
5502024-11-28T01:51:13.424ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-11-28T01:51:13.424ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone/oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc"), full_name: "oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone/oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc" } file = sled-storage/src/manager.rs:1331
5522024-11-28T01:51:13.522ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-11-28T01:51:13.522ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/zone/oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215"), full_name: "oxp_830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/zone/oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215" } file = sled-storage/src/manager.rs:1331
5542024-11-28T01:51:13.620ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-11-28T01:51:13.620ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5562024-11-28T01:51:13.709ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-11-28T01:51:13.710ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/debug"), full_name: "oxp_830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/debug" } file = sled-storage/src/manager.rs:1331
5582024-11-28T01:51:13.777ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-11-28T01:51:13.777ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/60dc1266-4525-4b36-849d-835d2a02f170/crypt/zone/oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c"), full_name: "oxp_60dc1266-4525-4b36-849d-835d2a02f170/crypt/zone/oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c" } file = sled-storage/src/manager.rs:1331
5602024-11-28T01:51:13.850ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.398571981s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
5612024-11-28T01:51:13.876ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-11-28T01:51:13.876ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone"), full_name: "oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone" } file = sled-storage/src/manager.rs:1331
5632024-11-28T01:51:13.944ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-11-28T01:51:13.944ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/60dc1266-4525-4b36-849d-835d2a02f170/crypt/zone/oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86"), full_name: "oxp_60dc1266-4525-4b36-849d-835d2a02f170/crypt/zone/oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86" } file = sled-storage/src/manager.rs:1331
5652024-11-28T01:51:14.046ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-11-28T01:51:14.046ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c9996824-866a-4451-99ce-f11f76d585ed/crypt/zone/oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df"), full_name: "oxp_c9996824-866a-4451-99ce-f11f76d585ed/crypt/zone/oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df" } file = sled-storage/src/manager.rs:1331
5672024-11-28T01:51:14.172ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-11-28T01:51:14.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c9996824-866a-4451-99ce-f11f76d585ed/crypt/debug"), full_name: "oxp_c9996824-866a-4451-99ce-f11f76d585ed/crypt/debug" } file = sled-storage/src/manager.rs:1331
5692024-11-28T01:51:14.188ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/probe_manager.rs:231 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
5702024-11-28T01:51:14.241ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5712024-11-28T01:51:14.241ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone/oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00"), full_name: "oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone/oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00" } file = sled-storage/src/manager.rs:1331
5722024-11-28T01:51:14.340ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5732024-11-28T01:51:14.340ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/60dc1266-4525-4b36-849d-835d2a02f170/crypt/debug"), full_name: "oxp_60dc1266-4525-4b36-849d-835d2a02f170/crypt/debug" } file = sled-storage/src/manager.rs:1331
5742024-11-28T01:51:14.411ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5752024-11-28T01:51:14.411ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_830b5e11-e6e4-4144-bc16-2396db6d872e/crucible" } file = sled-storage/src/manager.rs:1331
5762024-11-28T01:51:14.501ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-11-28T01:51:14.501ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5782024-11-28T01:51:14.593ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5792024-11-28T01:51:14.593ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone/oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd"), full_name: "oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone/oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd" } file = sled-storage/src/manager.rs:1331
5802024-11-28T01:51:14.697ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5812024-11-28T01:51:14.697ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone/oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4"), full_name: "oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/zone/oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4" } file = sled-storage/src/manager.rs:1331
5822024-11-28T01:51:14.795ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-11-28T01:51:14.796ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5842024-11-28T01:51:14.885ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-11-28T01:51:14.885ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crucible" } file = sled-storage/src/manager.rs:1331
5862024-11-28T01:51:14.983ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5872024-11-28T01:51:14.983ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone/oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214"), full_name: "oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/zone/oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214" } file = sled-storage/src/manager.rs:1331
5882024-11-28T01:51:15.086ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5892024-11-28T01:51:15.086ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5902024-11-28T01:51:15.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5912024-11-28T01:51:15.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5922024-11-28T01:51:15.190ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/probe_manager.rs:231 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
5932024-11-28T01:51:15.268ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5942024-11-28T01:51:15.268ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89678a9e-6cf0-40f7-a395-8631085163d8/crypt/debug"), full_name: "oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crypt/debug" } file = sled-storage/src/manager.rs:1331
5952024-11-28T01:51:15.338ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5962024-11-28T01:51:15.338ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/debug"), full_name: "oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/debug" } file = sled-storage/src/manager.rs:1331
5972024-11-28T01:51:15.378ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5982024-11-28T01:51:15.378ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5992024-11-28T01:51:15.384ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
6002024-11-28T01:51:15.384ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
6012024-11-28T01:51:15.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6022024-11-28T01:51:15.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
6032024-11-28T01:51:15.519ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6042024-11-28T01:51:15.519ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/zone/oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf"), full_name: "oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/zone/oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf" } file = sled-storage/src/manager.rs:1331
6052024-11-28T01:51:15.543ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6062024-11-28T01:51:15.543ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6072024-11-28T01:51:15.590ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6082024-11-28T01:51:15.590ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6092024-11-28T01:51:15.631ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6102024-11-28T01:51:15.632ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6112024-11-28T01:51:15.632ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
6122024-11-28T01:51:15.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5856692 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41014 req_id = 0e140fc3-1e3f-4f28-8941-3c4be01d0b46 response_code = 200 uri = /datasets
6132024-11-28T01:51:15.642ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6142024-11-28T01:51:15.642ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6152024-11-28T01:51:15.663ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6162024-11-28T01:51:15.664ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6172024-11-28T01:51:15.683ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4 (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 41ea4a99-3038-474e-bf28-2ad338f3243f (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
6182024-11-28T01:51:15.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39418
6192024-11-28T01:51:15.683ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6202024-11-28T01:51:15.683ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6212024-11-28T01:51:15.717ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6222024-11-28T01:51:15.717ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6232024-11-28T01:51:15.741ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6242024-11-28T01:51:15.741ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6252024-11-28T01:51:15.751ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6262024-11-28T01:51:15.751ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }
6272024-11-28T01:51:15.788ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6282024-11-28T01:51:15.788ZINFOSledAgent (ServiceManager): No ledger in /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:188
6292024-11-28T01:51:15.788ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:188
6302024-11-28T01:51:15.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6312024-11-28T01:51:15.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6322024-11-28T01:51:15.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6332024-11-28T01:51:15.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6342024-11-28T01:51:15.842ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6352024-11-28T01:51:15.842ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6362024-11-28T01:51:15.896ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f file = illumos-utils/src/zone.rs:325
6372024-11-28T01:51:15.900ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f file = illumos-utils/src/zone.rs:325
6382024-11-28T01:51:15.905ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4 file = illumos-utils/src/zone.rs:325
6392024-11-28T01:51:15.908ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6402024-11-28T01:51:15.909ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/nexus.rs:527 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
6412024-11-28T01:51:15.916ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f file = illumos-utils/src/zone.rs:363
6422024-11-28T01:51:15.921ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f file = illumos-utils/src/zone.rs:363
6432024-11-28T01:51:15.926ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4 file = illumos-utils/src/zone.rs:363
6442024-11-28T01:51:15.950ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6452024-11-28T01:51:15.950ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6462024-11-28T01:51:15.951ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6472024-11-28T01:51:15.951ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6482024-11-28T01:51:15.990ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6492024-11-28T01:51:16.011ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1878049001486582858 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
6502024-11-28T01:51:16.012ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6139042138682739278 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
6512024-11-28T01:51:16.068ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6522024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6532024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6542024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6552024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6562024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6572024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6582024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6592024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6602024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6612024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6622024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6632024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6642024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6652024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6662024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6672024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6682024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6692024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6702024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6712024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6722024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6732024-11-28T01:51:16.068ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6742024-11-28T01:51:16.192ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/313847b3-d670-4167-9b09-9e7d3dfcb2a4) file = sled-agent/src/probe_manager.rs:231 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
6752024-11-28T01:51:16.473ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18123829972584498529 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
6762024-11-28T01:51:16.473ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9942302142470360913 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
6772024-11-28T01:51:17.506ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782024-11-28T01:51:17.506ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6792024-11-28T01:51:17.985ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-11-28T01:51:17.985ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f
6812024-11-28T01:51:18.470ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6822024-11-28T01:51:18.470ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-11-28T01:51:18.470ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6842024-11-28T01:51:18.470ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
6852024-11-28T01:51:18.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f") failed: Property not found. retry in 33.056012ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f
6862024-11-28T01:51:18.487ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4
6872024-11-28T01:51:18.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f") failed: Property not found. retry in 139.70127ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f
6882024-11-28T01:51:18.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f") failed: Property not found. retry in 69.762649ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
6892024-11-28T01:51:18.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4") failed: Property not found. retry in 66.031545ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4
6902024-11-28T01:51:18.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f") failed: Property not found. retry in 138.463429ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f
6912024-11-28T01:51:18.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f") failed: Property not found. retry in 118.239079ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
6922024-11-28T01:51:18.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4") failed: Property not found. retry in 98.082164ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4
6932024-11-28T01:51:18.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f") failed: Property not found. retry in 586.794538ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f
6942024-11-28T01:51:19.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f") failed: Property not found. retry in 122.387763ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
6952024-11-28T01:51:19.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4") failed: Property not found. retry in 246.220238ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4
6962024-11-28T01:51:19.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f") failed: Property not found. retry in 283.493753ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
6972024-11-28T01:51:19.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4") failed: Property not found. retry in 465.893081ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4
6982024-11-28T01:51:19.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f") failed: Property not found. retry in 911.626474ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
6992024-11-28T01:51:19.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f") failed: Property not found. retry in 965.120708ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f
7002024-11-28T01:51:19.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4") failed: Property not found. retry in 756.221769ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4
7012024-11-28T01:51:20.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f") failed: Property not found. retry in 1.164343136s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
7022024-11-28T01:51:20.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f") failed: Property not found. retry in 1.467204072s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f
7032024-11-28T01:51:20.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4") failed: Property not found. retry in 1.342475797s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4
7042024-11-28T01:51:21.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f") failed: Property not found. retry in 666.192662ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
7052024-11-28T01:51:21.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4") failed: Property not found. retry in 1.340787667s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4
7062024-11-28T01:51:22.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f") failed: Property not found. retry in 737.103272ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f
7072024-11-28T01:51:22.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f") failed: Property not found. retry in 669.231367ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
7082024-11-28T01:51:22.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f") failed: Property not found. retry in 1.396025379s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f
7092024-11-28T01:51:22.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f") failed: Property not found. retry in 1.210938598s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
7102024-11-28T01:51:23.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4") failed: Property not found. retry in 708.041199ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4
7112024-11-28T01:51:24.193ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_41ea4a99-3038-474e-bf28-2ad338f3243f
7122024-11-28T01:51:24.193ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f
7132024-11-28T01:51:24.193ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_9402a51b-d30f-4544-93ec-0f5dc7a485e4
7142024-11-28T01:51:24.193ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7152024-11-28T01:51:24.194ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7162024-11-28T01:51:24.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8510829 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39418 req_id = 931cb3e2-44ee-44ac-bb9b-d96e309dfa78 response_code = 204 uri = /omicron-zones
7172024-11-28T01:51:24.196ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7182024-11-28T01:51:24.226ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 147.2438ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:662
7192024-11-28T01:51:24.391ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7202024-11-28T01:51:24.489ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 147.170952ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:662
7212024-11-28T01:51:24.654ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7222024-11-28T01:51:24.700ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:678
7232024-11-28T01:51:24.700ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7242024-11-28T01:51:24.730ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7252024-11-28T01:51:24.731ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7262024-11-28T01:51:24.731ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7272024-11-28T01:51:24.761ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4 (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 41ea4a99-3038-474e-bf28-2ad338f3243f (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ebc3c471-4bed-4708-aea5-ae996d3f7dbf (service), filesystem_pool: Some(ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0a4ed648-27cb-4ad4-82d9-3f8e2563c8ac, kind: Service { id: ebc3c471-4bed-4708-aea5-ae996d3f7dbf }, name: Name("ntp-ebc3c471-4bed-4708-aea5-ae996d3f7dbf"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 105])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
7282024-11-28T01:51:24.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50038
7292024-11-28T01:51:24.761ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7302024-11-28T01:51:24.761ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7312024-11-28T01:51:24.800ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7322024-11-28T01:51:24.800ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7332024-11-28T01:51:24.834ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7342024-11-28T01:51:24.834ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }
7352024-11-28T01:51:24.869ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7362024-11-28T01:51:24.869ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:177
7372024-11-28T01:51:24.870ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:177
7382024-11-28T01:51:24.870ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7392024-11-28T01:51:24.881ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7402024-11-28T01:51:24.913ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7412024-11-28T01:51:24.914ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7422024-11-28T01:51:24.914ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7432024-11-28T01:51:24.945ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 252, 105]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7442024-11-28T01:51:24.945ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7452024-11-28T01:51:24.945ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7462024-11-28T01:51:24.945ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7472024-11-28T01:51:24.946ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7482024-11-28T01:51:24.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7492024-11-28T01:51:24.971ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf file = illumos-utils/src/zone.rs:325
7502024-11-28T01:51:24.990ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf file = illumos-utils/src/zone.rs:363
7512024-11-28T01:51:25.611ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7522024-11-28T01:51:25.611ZINFOSledAgent (ServiceManager): Booting oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf
7532024-11-28T01:51:25.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf") failed: Property not found. retry in 47.916489ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf
7542024-11-28T01:51:25.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf") failed: Property not found. retry in 75.284237ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf
7552024-11-28T01:51:25.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf") failed: Property not found. retry in 229.264645ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf
7562024-11-28T01:51:26.013ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1878049001486582858 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7572024-11-28T01:51:26.013ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6139042138682739278 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7582024-11-28T01:51:26.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf") failed: Property not found. retry in 294.744502ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf
7592024-11-28T01:51:26.474ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18123829972584498529 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7602024-11-28T01:51:26.474ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9942302142470360913 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7612024-11-28T01:51:26.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf") failed: Property not found. retry in 1.150436909s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf
7622024-11-28T01:51:27.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf") failed: Property not found. retry in 955.64533ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf
7632024-11-28T01:51:28.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf") failed: Property not found. retry in 1.48621804s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf
7642024-11-28T01:51:30.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf") failed: Property not found. retry in 550.02396ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf
7652024-11-28T01:51:30.689ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf
7662024-11-28T01:51:30.689ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672024-11-28T01:51:30.690ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682024-11-28T01:51:30.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5929161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50038 req_id = fb6b500c-4fec-485a-b2c9-d2d1f1bbe530 response_code = 204 uri = /omicron-zones
7692024-11-28T01:51:30.693ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:719
7702024-11-28T01:51:30.724ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7712024-11-28T01:51:30.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60916
7722024-11-28T01:51:30.734ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7732024-11-28T01:51:30.735ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60916 req_id = 7f37047b-5c37-4648-916b-096f9dbb9558 response_code = 500 uri = /timesync
7742024-11-28T01:51:30.737ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7752024-11-28T01:51:30.857ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7762024-11-28T01:51:30.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43025
7772024-11-28T01:51:34.015ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12121090212364639777 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7782024-11-28T01:51:34.153ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7007486524073125282 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7792024-11-28T01:51:34.195ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2605986091919874199 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7802024-11-28T01:51:34.866ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7812024-11-28T01:51:34.866ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43025 req_id = 983be10a-50ac-466e-9cb4-50636ebe25f7 response_code = 500 uri = /timesync
7822024-11-28T01:51:34.869ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7832024-11-28T01:51:34.995ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7842024-11-28T01:51:34.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47027
7852024-11-28T01:51:35.004ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7862024-11-28T01:51:35.004ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8998 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47027 req_id = 4797cad3-23c8-449c-864c-141faa89e7fb response_code = 500 uri = /timesync
7872024-11-28T01:51:35.008ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7882024-11-28T01:51:35.138ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7892024-11-28T01:51:35.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48552
7902024-11-28T01:51:38.561ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ebc3c471-4bed-4708-aea5-ae996d3f7dbf': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7912024-11-28T01:51:38.561ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48552 req_id = a1b28802-77e1-4234-a583-3186189db459 response_code = 500 uri = /timesync
7922024-11-28T01:51:38.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1878049001486582858 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7932024-11-28T01:51:38.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6139042138682739278 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7942024-11-28T01:51:38.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18123829972584498529 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7952024-11-28T01:51:38.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9942302142470360913 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
7962024-11-28T01:51:38.565ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7972024-11-28T01:51:38.718ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7982024-11-28T01:51:38.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48298
7992024-11-28T01:51:38.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48298 req_id = 850efee4-52a1-422a-8c6e-9568156a7416 response_code = 200 uri = /timesync
8002024-11-28T01:51:38.728ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.025150543 } file = sled-agent/src/rack_setup/service.rs:727
8012024-11-28T01:51:38.728ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8022024-11-28T01:51:39.054ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8032024-11-28T01:51:39.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39237
8042024-11-28T01:51:39.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39237 req_id = 0a7213b0-d135-421f-ac06-c5cc768fc5f3 response_code = 200 uri = /timesync
8052024-11-28T01:51:39.064ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.024238072 } file = sled-agent/src/rack_setup/service.rs:727
8062024-11-28T01:51:39.064ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8072024-11-28T01:51:39.296ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8082024-11-28T01:51:39.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51428
8092024-11-28T01:51:39.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7755 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51428 req_id = 03d2ea22-c6a5-4cc9-85a2-f89b9581e04f response_code = 200 uri = /timesync
8102024-11-28T01:51:39.305ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.028581308 } file = sled-agent/src/rack_setup/service.rs:727
8112024-11-28T01:51:39.305ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8122024-11-28T01:51:39.621ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8132024-11-28T01:51:39.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65037
8142024-11-28T01:51:39.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7849 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65037 req_id = eaad10fa-3895-446d-a75b-7409a3bd801a response_code = 200 uri = /timesync
8152024-11-28T01:51:39.630ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.027698793 } file = sled-agent/src/rack_setup/service.rs:727
8162024-11-28T01:51:39.630ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8172024-11-28T01:51:40.102ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8182024-11-28T01:51:40.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62073
8192024-11-28T01:51:40.107ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9821957162836022070 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
8202024-11-28T01:51:40.107ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11138457297136885047 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
8212024-11-28T01:51:40.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62073 req_id = 73659e43-c4a1-44db-803d-09a954ce1688 response_code = 200 uri = /timesync
8222024-11-28T01:51:40.113ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.026387859 } file = sled-agent/src/rack_setup/service.rs:727
8232024-11-28T01:51:40.113ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8242024-11-28T01:51:40.738ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8252024-11-28T01:51:40.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41577
8262024-11-28T01:51:40.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8012 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41577 req_id = f909d632-a602-4e94-a581-4f54dd889cde response_code = 200 uri = /timesync
8272024-11-28T01:51:40.748ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.025183896 } file = sled-agent/src/rack_setup/service.rs:727
8282024-11-28T01:51:40.748ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8292024-11-28T01:51:41.314ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8302024-11-28T01:51:41.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33477
8312024-11-28T01:51:41.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21041 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33477 req_id = 50387e72-8529-4831-8018-8cf77232645d response_code = 200 uri = /timesync
8322024-11-28T01:51:41.338ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1732758701.121212, correction: -0.023352344 } file = sled-agent/src/rack_setup/service.rs:727
8332024-11-28T01:51:41.338ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1412
8342024-11-28T01:51:41.369ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4 (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 41ea4a99-3038-474e-bf28-2ad338f3243f (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ebc3c471-4bed-4708-aea5-ae996d3f7dbf (service), filesystem_pool: Some(ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0a4ed648-27cb-4ad4-82d9-3f8e2563c8ac, kind: Service { id: ebc3c471-4bed-4708-aea5-ae996d3f7dbf }, name: Name("ntp-ebc3c471-4bed-4708-aea5-ae996d3f7dbf"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 105])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: d600e7ee-31f1-4814-be2d-4108b251ac85 (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } } } }, OmicronZoneConfig { id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958 (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } } } }, OmicronZoneConfig { id: e012938a-b548-408d-9379-7503bc682cd5 (service), filesystem_pool: Some(ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External } } } }, OmicronZoneConfig { id: de4ffc97-f8c2-4704-be1c-411fbcd8c214 (service), filesystem_pool: Some(ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
8352024-11-28T01:51:41.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62654
8362024-11-28T01:51:41.370ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8372024-11-28T01:51:41.370ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8382024-11-28T01:51:41.404ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8392024-11-28T01:51:41.404ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8402024-11-28T01:51:41.436ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8412024-11-28T01:51:41.436ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }
8422024-11-28T01:51:41.468ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8432024-11-28T01:51:41.468ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8442024-11-28T01:51:41.501ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d600e7ee-31f1-4814-be2d-4108b251ac85, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8452024-11-28T01:51:41.501ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d600e7ee-31f1-4814-be2d-4108b251ac85, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8462024-11-28T01:51:41.533ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8472024-11-28T01:51:41.534ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Cockroach }, responder: ... }
8482024-11-28T01:51:41.564ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e012938a-b548-408d-9379-7503bc682cd5, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8492024-11-28T01:51:41.564ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e012938a-b548-408d-9379-7503bc682cd5, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8502024-11-28T01:51:41.595ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de4ffc97-f8c2-4704-be1c-411fbcd8c214, dataset_name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8512024-11-28T01:51:41.595ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: de4ffc97-f8c2-4704-be1c-411fbcd8c214, dataset_name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Cockroach }, responder: ... }
8522024-11-28T01:51:41.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8532024-11-28T01:51:41.626ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:177
8542024-11-28T01:51:41.627ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:177
8552024-11-28T01:51:41.627ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8562024-11-28T01:51:41.657ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
8572024-11-28T01:51:41.657ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
8582024-11-28T01:51:41.657ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
8592024-11-28T01:51:41.657ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
8602024-11-28T01:51:41.657ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
8612024-11-28T01:51:41.657ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b", TimeNotSynchronized), ("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214", TimeNotSynchronized), ("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85", TimeNotSynchronized), ("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958", TimeNotSynchronized), ("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 288554 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62654 req_id = 11fc5b67-2283-4e94-8dba-93bdff8ba0e7 response_code = 500 uri = /omicron-zones
8622024-11-28T01:51:41.657ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "11fc5b67-2283-4e94-8dba-93bdff8ba0e7", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "11fc5b67-2283-4e94-8dba-93bdff8ba0e7" } file = sled-agent/src/rack_setup/service.rs:562 retry_after = 95.860285ms sled_address = [fd00:1122:3344:101::1]:12345
8632024-11-28T01:51:41.754ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4 (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 41ea4a99-3038-474e-bf28-2ad338f3243f (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ebc3c471-4bed-4708-aea5-ae996d3f7dbf (service), filesystem_pool: Some(ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0a4ed648-27cb-4ad4-82d9-3f8e2563c8ac, kind: Service { id: ebc3c471-4bed-4708-aea5-ae996d3f7dbf }, name: Name("ntp-ebc3c471-4bed-4708-aea5-ae996d3f7dbf"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 105])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: d600e7ee-31f1-4814-be2d-4108b251ac85 (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } } } }, OmicronZoneConfig { id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958 (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } } } }, OmicronZoneConfig { id: e012938a-b548-408d-9379-7503bc682cd5 (service), filesystem_pool: Some(ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External } } } }, OmicronZoneConfig { id: de4ffc97-f8c2-4704-be1c-411fbcd8c214 (service), filesystem_pool: Some(ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
8642024-11-28T01:51:41.755ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8652024-11-28T01:51:41.755ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8662024-11-28T01:51:41.787ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8672024-11-28T01:51:41.787ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8682024-11-28T01:51:41.816ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8692024-11-28T01:51:41.816ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }
8702024-11-28T01:51:41.848ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8712024-11-28T01:51:41.848ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8722024-11-28T01:51:41.879ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d600e7ee-31f1-4814-be2d-4108b251ac85, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8732024-11-28T01:51:41.879ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d600e7ee-31f1-4814-be2d-4108b251ac85, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8742024-11-28T01:51:41.912ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8752024-11-28T01:51:41.912ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Cockroach }, responder: ... }
8762024-11-28T01:51:41.943ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e012938a-b548-408d-9379-7503bc682cd5, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8772024-11-28T01:51:41.943ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e012938a-b548-408d-9379-7503bc682cd5, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8782024-11-28T01:51:41.975ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de4ffc97-f8c2-4704-be1c-411fbcd8c214, dataset_name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8792024-11-28T01:51:41.975ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: de4ffc97-f8c2-4704-be1c-411fbcd8c214, dataset_name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Cockroach }, responder: ... }
8802024-11-28T01:51:42.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8812024-11-28T01:51:42.007ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:177
8822024-11-28T01:51:42.007ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:177
8832024-11-28T01:51:42.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8842024-11-28T01:51:42.042ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
8852024-11-28T01:51:42.042ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
8862024-11-28T01:51:42.042ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
8872024-11-28T01:51:42.042ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
8882024-11-28T01:51:42.042ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
8892024-11-28T01:51:42.042ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85", TimeNotSynchronized), ("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214", TimeNotSynchronized), ("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958", TimeNotSynchronized), ("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5", TimeNotSynchronized), ("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 288311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62654 req_id = 13ad2b70-4de2-450b-8077-ace822f2f622 response_code = 500 uri = /omicron-zones
8902024-11-28T01:51:42.042ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "13ad2b70-4de2-450b-8077-ace822f2f622", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:41 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "13ad2b70-4de2-450b-8077-ace822f2f622" } file = sled-agent/src/rack_setup/service.rs:562 retry_after = 106.664228ms sled_address = [fd00:1122:3344:101::1]:12345
8912024-11-28T01:51:42.149ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4 (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 41ea4a99-3038-474e-bf28-2ad338f3243f (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ebc3c471-4bed-4708-aea5-ae996d3f7dbf (service), filesystem_pool: Some(ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0a4ed648-27cb-4ad4-82d9-3f8e2563c8ac, kind: Service { id: ebc3c471-4bed-4708-aea5-ae996d3f7dbf }, name: Name("ntp-ebc3c471-4bed-4708-aea5-ae996d3f7dbf"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 105])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: d600e7ee-31f1-4814-be2d-4108b251ac85 (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } } } }, OmicronZoneConfig { id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958 (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } } } }, OmicronZoneConfig { id: e012938a-b548-408d-9379-7503bc682cd5 (service), filesystem_pool: Some(ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External } } } }, OmicronZoneConfig { id: de4ffc97-f8c2-4704-be1c-411fbcd8c214 (service), filesystem_pool: Some(ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
8922024-11-28T01:51:42.149ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8932024-11-28T01:51:42.149ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8942024-11-28T01:51:42.183ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8952024-11-28T01:51:42.184ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8962024-11-28T01:51:42.215ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8972024-11-28T01:51:42.215ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }
8982024-11-28T01:51:42.246ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8992024-11-28T01:51:42.246ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9002024-11-28T01:51:42.279ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d600e7ee-31f1-4814-be2d-4108b251ac85, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9012024-11-28T01:51:42.279ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d600e7ee-31f1-4814-be2d-4108b251ac85, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9022024-11-28T01:51:42.311ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9032024-11-28T01:51:42.311ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Cockroach }, responder: ... }
9042024-11-28T01:51:42.343ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e012938a-b548-408d-9379-7503bc682cd5, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9052024-11-28T01:51:42.343ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e012938a-b548-408d-9379-7503bc682cd5, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9062024-11-28T01:51:42.377ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de4ffc97-f8c2-4704-be1c-411fbcd8c214, dataset_name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9072024-11-28T01:51:42.377ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: de4ffc97-f8c2-4704-be1c-411fbcd8c214, dataset_name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Cockroach }, responder: ... }
9082024-11-28T01:51:42.410ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9092024-11-28T01:51:42.410ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:177
9102024-11-28T01:51:42.410ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:177
9112024-11-28T01:51:42.410ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9122024-11-28T01:51:42.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9132024-11-28T01:51:42.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9142024-11-28T01:51:42.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9152024-11-28T01:51:42.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9162024-11-28T01:51:42.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9172024-11-28T01:51:42.583ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958 file = illumos-utils/src/zone.rs:325
9182024-11-28T01:51:42.587ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85 file = illumos-utils/src/zone.rs:325
9192024-11-28T01:51:42.591ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5 file = illumos-utils/src/zone.rs:325
9202024-11-28T01:51:42.595ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b file = illumos-utils/src/zone.rs:325
9212024-11-28T01:51:42.599ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214 file = illumos-utils/src/zone.rs:325
9222024-11-28T01:51:42.604ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958 file = illumos-utils/src/zone.rs:363
9232024-11-28T01:51:42.609ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85 file = illumos-utils/src/zone.rs:363
9242024-11-28T01:51:42.613ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5 file = illumos-utils/src/zone.rs:363
9252024-11-28T01:51:42.617ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b file = illumos-utils/src/zone.rs:363
9262024-11-28T01:51:42.622ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214 file = illumos-utils/src/zone.rs:363
9272024-11-28T01:51:42.692ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 374.016516ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
9282024-11-28T01:51:44.986ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46840
9292024-11-28T01:51:44.986ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46840 req_id = efdce6b7-5cf1-45a2-ae4a-8ec6b42d28ac response_code = 200 uri = /baseboard
9302024-11-28T01:51:45.498ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='0f53ee1c-360d-456d-a29b-f282b8c8fc1b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9312024-11-28T01:51:45.498ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9322024-11-28T01:51:45.524ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d600e7ee-31f1-4814-be2d-4108b251ac85'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9332024-11-28T01:51:45.524ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9342024-11-28T01:51:45.588ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='56d0ae2d-9bbc-4237-a6f5-c2295a434958'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9352024-11-28T01:51:45.588ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9362024-11-28T01:51:45.621ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='de4ffc97-f8c2-4704-be1c-411fbcd8c214'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9372024-11-28T01:51:45.621ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9382024-11-28T01:51:45.633ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e012938a-b548-408d-9379-7503bc682cd5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9392024-11-28T01:51:45.633ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9402024-11-28T01:51:45.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 63.551683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9412024-11-28T01:51:45.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 73.691321ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9422024-11-28T01:51:45.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 145.868288ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9432024-11-28T01:51:45.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 96.310648ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9442024-11-28T01:51:45.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958") failed: Property not found. retry in 49.140487ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9452024-11-28T01:51:45.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 248.336613ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9462024-11-28T01:51:45.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 186.897242ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9472024-11-28T01:51:45.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958") failed: Property not found. retry in 94.602703ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9482024-11-28T01:51:46.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 34.578482ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9492024-11-28T01:51:46.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214") failed: Property not found. retry in 62.723529ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9502024-11-28T01:51:46.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958") failed: Property not found. retry in 121.769603ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9512024-11-28T01:51:46.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 380.792668ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9522024-11-28T01:51:46.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 56.47392ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9532024-11-28T01:51:47.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 274.984724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9542024-11-28T01:51:47.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214") failed: Property not found. retry in 112.17371ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9552024-11-28T01:51:47.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958") failed: Property not found. retry in 387.693814ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9562024-11-28T01:51:47.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 1.145627569s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9572024-11-28T01:51:48.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 213.684765ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9582024-11-28T01:51:48.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214") failed: Property not found. retry in 110.629349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9592024-11-28T01:51:48.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 432.754242ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9602024-11-28T01:51:48.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214") failed: Property not found. retry in 482.536904ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9612024-11-28T01:51:48.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 348.10801ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9622024-11-28T01:51:48.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958") failed: Property not found. retry in 706.191667ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9632024-11-28T01:51:48.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 1.453057667s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9642024-11-28T01:51:48.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 728.974966ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9652024-11-28T01:51:48.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214") failed: Property not found. retry in 1.147687372s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9662024-11-28T01:51:49.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958") failed: Property not found. retry in 1.125996948s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9672024-11-28T01:51:49.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 885.930192ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9682024-11-28T01:51:49.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 1.2866442s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9692024-11-28T01:51:49.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214") failed: Property not found. retry in 984.729903ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9702024-11-28T01:51:50.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 770.663908ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9712024-11-28T01:51:50.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 658.222296ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9722024-11-28T01:51:50.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958") failed: Property not found. retry in 1.163055795s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9732024-11-28T01:51:50.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 1.464578072s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9742024-11-28T01:51:50.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 834.526198ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9752024-11-28T01:51:50.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 1.215419121s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9762024-11-28T01:51:50.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214") failed: Property not found. retry in 933.208862ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9772024-11-28T01:51:51.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958") failed: Property not found. retry in 1.300545269s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9782024-11-28T01:51:51.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 971.729312ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9792024-11-28T01:51:51.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214") failed: Property not found. retry in 1.353868506s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9802024-11-28T01:51:52.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 784.201935ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9812024-11-28T01:51:52.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 945.693755ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9822024-11-28T01:51:52.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 1.449628856s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9832024-11-28T01:51:52.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958") failed: Property not found. retry in 1.137812508s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9842024-11-28T01:51:52.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 702.074385ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9852024-11-28T01:51:53.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 580.646801ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9862024-11-28T01:51:53.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214") failed: Property not found. retry in 1.319194098s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9872024-11-28T01:51:53.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 1.342998729s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9882024-11-28T01:51:53.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 1.077757144s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9892024-11-28T01:51:53.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958") failed: Property not found. retry in 1.173341087s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9902024-11-28T01:51:54.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 926.828847ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9912024-11-28T01:51:54.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214") failed: Property not found. retry in 1.100224192s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
9922024-11-28T01:51:54.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5") failed: Property not found. retry in 613.319021ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9932024-11-28T01:51:54.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85") failed: Property not found. retry in 537.790848ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9942024-11-28T01:51:54.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b") failed: Property not found. retry in 937.797036ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9952024-11-28T01:51:55.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_56d0ae2d-9bbc-4237-a6f5-c2295a434958
9962024-11-28T01:51:55.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_d600e7ee-31f1-4814-be2d-4108b251ac85
9972024-11-28T01:51:55.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_e012938a-b548-408d-9379-7503bc682cd5
9982024-11-28T01:51:55.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b
9992024-11-28T01:51:55.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_de4ffc97-f8c2-4704-be1c-411fbcd8c214
10002024-11-28T01:51:55.912ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10012024-11-28T01:51:55.912ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10022024-11-28T01:51:55.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13782874 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62654 req_id = 01a42afb-e4a2-476d-904b-46ced6c60d0f response_code = 204 uri = /omicron-zones
10032024-11-28T01:51:55.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61733
10042024-11-28T01:51:55.975ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29597 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = 29977585-1755-41e6-b1a6-a72fe5bd7544 response_code = 500 uri = /cockroachdb
10052024-11-28T01:51:55.975ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "29977585-1755-41e6-b1a6-a72fe5bd7544", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "29977585-1755-41e6-b1a6-a72fe5bd7544" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 103.878884ms
10062024-11-28T01:51:56.108ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = 6e7a4216-9878-4986-af2a-0fd291dd74a5 response_code = 500 uri = /cockroachdb
10072024-11-28T01:51:56.109ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6e7a4216-9878-4986-af2a-0fd291dd74a5", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6e7a4216-9878-4986-af2a-0fd291dd74a5" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 118.080669ms
10082024-11-28T01:51:56.257ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29080 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = de00fb08-fe70-44ac-9681-99b2a0213dc3 response_code = 500 uri = /cockroachdb
10092024-11-28T01:51:56.257ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "de00fb08-fe70-44ac-9681-99b2a0213dc3", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "de00fb08-fe70-44ac-9681-99b2a0213dc3" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 106.034221ms
10102024-11-28T01:51:56.392ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28119 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = 76b97e86-7ff1-4fd3-b523-0a5d10d52db3 response_code = 500 uri = /cockroachdb
10112024-11-28T01:51:56.393ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "76b97e86-7ff1-4fd3-b523-0a5d10d52db3", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "76b97e86-7ff1-4fd3-b523-0a5d10d52db3" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 135.697493ms
10122024-11-28T01:51:56.558ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27913 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = c88d108c-dc1d-41f4-9b6c-ff2fea339b5d response_code = 500 uri = /cockroachdb
10132024-11-28T01:51:56.558ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c88d108c-dc1d-41f4-9b6c-ff2fea339b5d", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c88d108c-dc1d-41f4-9b6c-ff2fea339b5d" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 128.108276ms
10142024-11-28T01:51:56.714ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26364 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = d08a1802-ee84-46d6-8981-384dec018218 response_code = 500 uri = /cockroachdb
10152024-11-28T01:51:56.714ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d08a1802-ee84-46d6-8981-384dec018218", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d08a1802-ee84-46d6-8981-384dec018218" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 350.701799ms
10162024-11-28T01:51:57.093ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = da7d0146-64ba-4e39-a9fd-47c500fb7fec response_code = 500 uri = /cockroachdb
10172024-11-28T01:51:57.093ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "da7d0146-64ba-4e39-a9fd-47c500fb7fec", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "da7d0146-64ba-4e39-a9fd-47c500fb7fec" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 314.273013ms
10182024-11-28T01:51:57.434ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25784 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = 9cc55984-ed67-476e-b5a0-4d782eeeb6fc response_code = 500 uri = /cockroachdb
10192024-11-28T01:51:57.434ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9cc55984-ed67-476e-b5a0-4d782eeeb6fc", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9cc55984-ed67-476e-b5a0-4d782eeeb6fc" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 341.279593ms
10202024-11-28T01:51:57.804ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = a2c31b94-f1e0-404f-af2a-5e1379b9d23f response_code = 500 uri = /cockroachdb
10212024-11-28T01:51:57.804ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a2c31b94-f1e0-404f-af2a-5e1379b9d23f", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a2c31b94-f1e0-404f-af2a-5e1379b9d23f" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 474.564193ms
10222024-11-28T01:51:58.094ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 318.217225ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
10232024-11-28T01:51:58.307ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26838 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = 30e6426c-7bd9-4883-97b2-c878a5aa6787 response_code = 500 uri = /cockroachdb
10242024-11-28T01:51:58.307ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "30e6426c-7bd9-4883-97b2-c878a5aa6787", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "30e6426c-7bd9-4883-97b2-c878a5aa6787" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 306.063665ms
10252024-11-28T01:51:58.642ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0f53ee1c-360d-456d-a29b-f282b8c8fc1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = f5c92d14-5f57-49fd-bcf1-711ce4bf7adc response_code = 500 uri = /cockroachdb
10262024-11-28T01:51:58.642ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f5c92d14-5f57-49fd-bcf1-711ce4bf7adc", "content-length": "124", "date": "Thu, 28 Nov 2024 01:51:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f5c92d14-5f57-49fd-bcf1-711ce4bf7adc" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 905.824233ms
10272024-11-28T01:51:59.581ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3743
10282024-11-28T01:52:16.054ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
10292024-11-28T01:52:26.043ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
10302024-11-28T01:52:26.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26498102 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61733 req_id = 4b502d2a-ce6a-46c0-b4c7-428f6f1d4990 response_code = 204 uri = /cockroachdb
10312024-11-28T01:52:26.051ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37007
10322024-11-28T01:52:26.064ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37007 req_id = 7c5137e8-3a0c-4e91-acff-3899f71a0c8c response_code = 200 uri = /baseboard
10332024-11-28T01:52:26.081ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 944.860652ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
10342024-11-28T01:52:26.109ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4 (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 41ea4a99-3038-474e-bf28-2ad338f3243f (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ebc3c471-4bed-4708-aea5-ae996d3f7dbf (service), filesystem_pool: Some(ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0a4ed648-27cb-4ad4-82d9-3f8e2563c8ac, kind: Service { id: ebc3c471-4bed-4708-aea5-ae996d3f7dbf }, name: Name("ntp-ebc3c471-4bed-4708-aea5-ae996d3f7dbf"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 105])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: d600e7ee-31f1-4814-be2d-4108b251ac85 (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } } } }, OmicronZoneConfig { id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958 (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } } } }, OmicronZoneConfig { id: e012938a-b548-408d-9379-7503bc682cd5 (service), filesystem_pool: Some(ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External } } } }, OmicronZoneConfig { id: de4ffc97-f8c2-4704-be1c-411fbcd8c214 (service), filesystem_pool: Some(ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External } } } }, OmicronZoneConfig { id: eb274350-c0b0-4bce-9c8a-502880f2c905 (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 36d4f615-7461-4364-960c-89ece3aaabaf (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 (service), filesystem_pool: Some(ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc (service), filesystem_pool: Some(ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 (service), filesystem_pool: Some(ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 119eed64-2e24-4d5f-8c42-be6cd8bec8b5 (service), filesystem_pool: Some(ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: b334fd6a-2b27-4fad-b63a-4bb44c2464e8 (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 03aeb984-bba8-42eb-8614-cb86e5580f86 (service), filesystem_pool: Some(ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: eae490d2-fe44-4810-8815-063375ca7e2f (service), filesystem_pool: Some(ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 5ecc5ab3-da37-4a7a-9abe-dff407cafb00 (service), filesystem_pool: Some(ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 4f0fafe9-6076-4543-9e44-d38b39ebb133 (service), filesystem_pool: Some(ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5852adb9-5a7e-47cf-a1f4-e3f69c698ecd (service), filesystem_pool: Some(ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External } } } }, OmicronZoneConfig { id: 07b822d0-10f3-42de-b0a1-53274571b215 (service), filesystem_pool: Some(ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External } } } }, OmicronZoneConfig { id: c443e40c-7868-4dfc-9621-c787f7207178 (service), filesystem_pool: Some(ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External } } } }, OmicronZoneConfig { id: d24eaff3-a59b-4fb7-89de-6ce285942026 (service), filesystem_pool: Some(ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External } } } }, OmicronZoneConfig { id: 81e8c1b0-db2f-4eb4-ba08-7718441bf3df (service), filesystem_pool: Some(ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External } } } }, OmicronZoneConfig { id: c4172b9e-1bf8-491e-8277-58af196d34c0 (service), filesystem_pool: Some(ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External } } } }, OmicronZoneConfig { id: f0b1e661-688b-4f1f-b5d2-cc2c76439d4c (service), filesystem_pool: Some(ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9 (service), filesystem_pool: Some(ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
10352024-11-28T01:52:26.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60395
10362024-11-28T01:52:26.112ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10372024-11-28T01:52:26.112ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d23bc5f2-6b92-4992-bdd2-8695e5bf9c0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10382024-11-28T01:52:26.203ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10392024-11-28T01:52:26.203ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9402a51b-d30f-4544-93ec-0f5dc7a485e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10402024-11-28T01:52:26.254ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10412024-11-28T01:52:26.254ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 41ea4a99-3038-474e-bf28-2ad338f3243f, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: InternalDns }, responder: ... }
10422024-11-28T01:52:26.306ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10432024-11-28T01:52:26.306ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f53ee1c-360d-456d-a29b-f282b8c8fc1b, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10442024-11-28T01:52:26.353ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d600e7ee-31f1-4814-be2d-4108b251ac85, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10452024-11-28T01:52:26.353ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d600e7ee-31f1-4814-be2d-4108b251ac85, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10462024-11-28T01:52:26.407ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10472024-11-28T01:52:26.407ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 56d0ae2d-9bbc-4237-a6f5-c2295a434958, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10482024-11-28T01:52:26.457ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e012938a-b548-408d-9379-7503bc682cd5, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10492024-11-28T01:52:26.457ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e012938a-b548-408d-9379-7503bc682cd5, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10502024-11-28T01:52:26.513ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de4ffc97-f8c2-4704-be1c-411fbcd8c214, dataset_name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10512024-11-28T01:52:26.513ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: de4ffc97-f8c2-4704-be1c-411fbcd8c214, dataset_name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Cockroach }, responder: ... }
10522024-11-28T01:52:26.561ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eb274350-c0b0-4bce-9c8a-502880f2c905, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10532024-11-28T01:52:26.561ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: eb274350-c0b0-4bce-9c8a-502880f2c905, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10542024-11-28T01:52:26.607ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 36d4f615-7461-4364-960c-89ece3aaabaf, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10552024-11-28T01:52:26.607ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 36d4f615-7461-4364-960c-89ece3aaabaf, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10562024-11-28T01:52:26.653ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b334fd6a-2b27-4fad-b63a-4bb44c2464e8, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
10572024-11-28T01:52:26.653ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b334fd6a-2b27-4fad-b63a-4bb44c2464e8, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10582024-11-28T01:52:26.810ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4f0fafe9-6076-4543-9e44-d38b39ebb133, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10592024-11-28T01:52:26.810ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4f0fafe9-6076-4543-9e44-d38b39ebb133, dataset_name: DatasetName { pool_name: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, kind: Crucible }, responder: ... }
10602024-11-28T01:52:26.865ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5852adb9-5a7e-47cf-a1f4-e3f69c698ecd, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10612024-11-28T01:52:26.865ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5852adb9-5a7e-47cf-a1f4-e3f69c698ecd, dataset_name: DatasetName { pool_name: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, kind: Crucible }, responder: ... }
10622024-11-28T01:52:26.925ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 07b822d0-10f3-42de-b0a1-53274571b215, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10632024-11-28T01:52:26.925ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 07b822d0-10f3-42de-b0a1-53274571b215, dataset_name: DatasetName { pool_name: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, kind: Crucible }, responder: ... }
10642024-11-28T01:52:26.972ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c443e40c-7868-4dfc-9621-c787f7207178, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10652024-11-28T01:52:26.973ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c443e40c-7868-4dfc-9621-c787f7207178, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, kind: Crucible }, responder: ... }
10662024-11-28T01:52:27.020ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d24eaff3-a59b-4fb7-89de-6ce285942026, dataset_name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10672024-11-28T01:52:27.020ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d24eaff3-a59b-4fb7-89de-6ce285942026, dataset_name: DatasetName { pool_name: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, kind: Crucible }, responder: ... }
10682024-11-28T01:52:27.084ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 81e8c1b0-db2f-4eb4-ba08-7718441bf3df, dataset_name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10692024-11-28T01:52:27.084ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 81e8c1b0-db2f-4eb4-ba08-7718441bf3df, dataset_name: DatasetName { pool_name: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, kind: Crucible }, responder: ... }
10702024-11-28T01:52:27.156ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c4172b9e-1bf8-491e-8277-58af196d34c0, dataset_name: DatasetName { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10712024-11-28T01:52:27.156ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c4172b9e-1bf8-491e-8277-58af196d34c0, dataset_name: DatasetName { pool_name: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, kind: Crucible }, responder: ... }
10722024-11-28T01:52:27.217ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f0b1e661-688b-4f1f-b5d2-cc2c76439d4c, dataset_name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10732024-11-28T01:52:27.217ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f0b1e661-688b-4f1f-b5d2-cc2c76439d4c, dataset_name: DatasetName { pool_name: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, kind: Crucible }, responder: ... }
10742024-11-28T01:52:27.281ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9, dataset_name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10752024-11-28T01:52:27.282ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9, dataset_name: DatasetName { pool_name: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, kind: Crucible }, responder: ... }
10762024-11-28T01:52:27.338ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10772024-11-28T01:52:27.339ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:177
10782024-11-28T01:52:27.339ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:177
10792024-11-28T01:52:27.339ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10802024-11-28T01:52:27.475ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10812024-11-28T01:52:27.477ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10822024-11-28T01:52:27.478ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10832024-11-28T01:52:27.505ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10842024-11-28T01:52:27.506ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10852024-11-28T01:52:27.506ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10862024-11-28T01:52:27.506ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10872024-11-28T01:52:27.506ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10882024-11-28T01:52:27.506ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10892024-11-28T01:52:27.528ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10902024-11-28T01:52:27.683ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10912024-11-28T01:52:27.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10922024-11-28T01:52:27.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10932024-11-28T01:52:27.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10942024-11-28T01:52:27.730ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10952024-11-28T01:52:27.730ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10962024-11-28T01:52:27.730ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10972024-11-28T01:52:27.731ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10982024-11-28T01:52:27.731ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10992024-11-28T01:52:27.731ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8 file = illumos-utils/src/zone.rs:325
11002024-11-28T01:52:27.736ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f file = illumos-utils/src/zone.rs:325
11012024-11-28T01:52:27.740ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215 file = illumos-utils/src/zone.rs:325
11022024-11-28T01:52:27.745ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00 file = illumos-utils/src/zone.rs:325
11032024-11-28T01:52:27.750ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133 file = illumos-utils/src/zone.rs:325
11042024-11-28T01:52:27.755ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5 file = illumos-utils/src/zone.rs:325
11052024-11-28T01:52:27.760ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd file = illumos-utils/src/zone.rs:325
11062024-11-28T01:52:27.897ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8 file = illumos-utils/src/zone.rs:363
11072024-11-28T01:52:27.903ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f file = illumos-utils/src/zone.rs:363
11082024-11-28T01:52:27.908ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215 file = illumos-utils/src/zone.rs:363
11092024-11-28T01:52:27.913ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00 file = illumos-utils/src/zone.rs:363
11102024-11-28T01:52:27.917ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133 file = illumos-utils/src/zone.rs:363
11112024-11-28T01:52:27.922ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5 file = illumos-utils/src/zone.rs:363
11122024-11-28T01:52:27.927ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd file = illumos-utils/src/zone.rs:363
11132024-11-28T01:52:27.932ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178 file = illumos-utils/src/zone.rs:325
11142024-11-28T01:52:27.936ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026 file = illumos-utils/src/zone.rs:325
11152024-11-28T01:52:27.941ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df file = illumos-utils/src/zone.rs:325
11162024-11-28T01:52:27.946ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86 file = illumos-utils/src/zone.rs:325
11172024-11-28T01:52:27.951ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0 file = illumos-utils/src/zone.rs:325
11182024-11-28T01:52:27.956ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c file = illumos-utils/src/zone.rs:325
11192024-11-28T01:52:27.962ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9 file = illumos-utils/src/zone.rs:325
11202024-11-28T01:52:28.011ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11212024-11-28T01:52:28.012ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178 file = illumos-utils/src/zone.rs:363
11222024-11-28T01:52:28.023ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026 file = illumos-utils/src/zone.rs:363
11232024-11-28T01:52:28.032ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df file = illumos-utils/src/zone.rs:363
11242024-11-28T01:52:28.040ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86 file = illumos-utils/src/zone.rs:363
11252024-11-28T01:52:28.048ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0 file = illumos-utils/src/zone.rs:363
11262024-11-28T01:52:28.056ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c file = illumos-utils/src/zone.rs:363
11272024-11-28T01:52:28.065ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9 file = illumos-utils/src/zone.rs:363
11282024-11-28T01:52:28.127ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11292024-11-28T01:52:28.194ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11302024-11-28T01:52:28.259ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11312024-11-28T01:52:28.262ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11322024-11-28T01:52:28.262ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11332024-11-28T01:52:28.321ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 140, 1]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11342024-11-28T01:52:28.321ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
11352024-11-28T01:52:28.381ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11362024-11-28T01:52:28.382ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11372024-11-28T01:52:28.382ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11382024-11-28T01:52:28.437ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 167, 213]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11392024-11-28T01:52:28.437ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11402024-11-28T01:52:28.439ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11412024-11-28T01:52:28.439ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11422024-11-28T01:52:28.495ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 228, 85]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11432024-11-28T01:52:28.495ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11442024-11-28T01:52:28.497ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11452024-11-28T01:52:28.497ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11462024-11-28T01:52:28.558ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 221, 212]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11472024-11-28T01:52:28.558ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11482024-11-28T01:52:28.559ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11492024-11-28T01:52:28.563ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11502024-11-28T01:52:28.565ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11512024-11-28T01:52:28.565ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11522024-11-28T01:52:28.624ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 133, 17]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11532024-11-28T01:52:28.624ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
11542024-11-28T01:52:28.624ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11552024-11-28T01:52:28.626ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11562024-11-28T01:52:28.626ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11572024-11-28T01:52:28.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11582024-11-28T01:52:28.690ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11592024-11-28T01:52:28.690ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11602024-11-28T01:52:28.690ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11612024-11-28T01:52:28.692ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11622024-11-28T01:52:28.692ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11632024-11-28T01:52:28.693ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11642024-11-28T01:52:28.697ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11652024-11-28T01:52:28.746ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11662024-11-28T01:52:28.749ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11672024-11-28T01:52:28.749ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11682024-11-28T01:52:28.750ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11692024-11-28T01:52:28.750ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11702024-11-28T01:52:28.755ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf file = illumos-utils/src/zone.rs:325
11712024-11-28T01:52:28.824ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1 file = illumos-utils/src/zone.rs:325
11722024-11-28T01:52:28.900ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11732024-11-28T01:52:28.908ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11742024-11-28T01:52:28.908ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf file = illumos-utils/src/zone.rs:363
11752024-11-28T01:52:28.918ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc file = illumos-utils/src/zone.rs:325
11762024-11-28T01:52:28.928ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1 file = illumos-utils/src/zone.rs:363
11772024-11-28T01:52:28.937ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17 file = illumos-utils/src/zone.rs:325
11782024-11-28T01:52:28.995ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc file = illumos-utils/src/zone.rs:363
11792024-11-28T01:52:29.006ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17 file = illumos-utils/src/zone.rs:363
11802024-11-28T01:52:29.023ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905 file = illumos-utils/src/zone.rs:325
11812024-11-28T01:52:29.062ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905 file = illumos-utils/src/zone.rs:363
11822024-11-28T01:52:37.607ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11832024-11-28T01:52:37.687ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11842024-11-28T01:52:37.725ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
11852024-11-28T01:52:37.789ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_89678a9e-6cf0-40f7-a395-8631085163d8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bb15b20b-7104-4216-8a81-d3df266f10e5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11862024-11-28T01:52:37.843ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='17cb1fc0-8499-4ee4-bd63-a5e59d9a360e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11872024-11-28T01:52:37.844ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e70f1c2e-aabf-477c-b0e0-2fc5883ec392'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11882024-11-28T01:52:37.844ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bda37aad-8ee5-46b6-87c6-962da4a4ceac'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11892024-11-28T01:52:37.844ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c9996824-866a-4451-99ce-f11f76d585ed/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4b4217a4-b6f9-432a-b7b9-f08c918181dd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902024-11-28T01:52:37.845ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
11912024-11-28T01:52:37.853ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='79021a87-b022-48e6-8ee0-a5c2546158c2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11922024-11-28T01:52:37.853ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_60dc1266-4525-4b36-849d-835d2a02f170/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3b90027f-90f8-4443-97c8-a4195b255f3c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11932024-11-28T01:52:37.853ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8494638f-7fbc-4e57-80ca-c7b9a0d2c78e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11942024-11-28T01:52:37.854ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11952024-11-28T01:52:37.859ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11962024-11-28T01:52:37.859ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11972024-11-28T01:52:37.859ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_830b5e11-e6e4-4144-bc16-2396db6d872e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f65e4faa-6ea9-4842-ad49-269c5409ece0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982024-11-28T01:52:37.859ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
11992024-11-28T01:52:37.867ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
12002024-11-28T01:52:37.873ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
12012024-11-28T01:52:37.878ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
12022024-11-28T01:52:37.885ZINFOSledAgent (ServiceManager): Booting oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
12032024-11-28T01:52:37.892ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
12042024-11-28T01:52:37.897ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
12052024-11-28T01:52:37.903ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
12062024-11-28T01:52:37.909ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
12072024-11-28T01:52:37.916ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
12082024-11-28T01:52:37.921ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
12092024-11-28T01:52:37.927ZINFOSledAgent (ServiceManager): Booting oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
12102024-11-28T01:52:38.272ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='119eed64-2e24-4d5f-8c42-be6cd8bec8b5'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12112024-11-28T01:52:38.272ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
12122024-11-28T01:52:40.108ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12132024-11-28T01:52:40.109ZINFOSledAgent (ServiceManager): Booting oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
12142024-11-28T01:52:40.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 53.217486ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
12152024-11-28T01:52:40.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 68.131843ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
12162024-11-28T01:52:40.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 72.585544ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
12172024-11-28T01:52:40.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 31.87031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
12182024-11-28T01:52:40.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 47.48647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
12192024-11-28T01:52:40.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 49.571874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
12202024-11-28T01:52:40.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 51.137309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
12212024-11-28T01:52:40.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 47.798045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
12222024-11-28T01:52:40.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 71.985474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
12232024-11-28T01:52:40.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 32.15844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
12242024-11-28T01:52:40.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 28.499164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
12252024-11-28T01:52:40.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 55.533768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
12262024-11-28T01:52:40.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 57.452677ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
12272024-11-28T01:52:40.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 56.888753ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
12282024-11-28T01:52:40.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 99.366794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
12292024-11-28T01:52:40.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 64.74004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
12302024-11-28T01:52:40.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 140.207953ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
12312024-11-28T01:52:40.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 122.794007ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
12322024-11-28T01:52:40.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 70.806891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
12332024-11-28T01:52:40.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 121.644186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
12342024-11-28T01:52:40.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 143.727274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
12352024-11-28T01:52:40.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 37.183871ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
12362024-11-28T01:52:40.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 86.359983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
12372024-11-28T01:52:40.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 134.702952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
12382024-11-28T01:52:40.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 111.073119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
12392024-11-28T01:52:40.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 73.12825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
12402024-11-28T01:52:40.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 69.273097ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
12412024-11-28T01:52:41.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 222.800131ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
12422024-11-28T01:52:41.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 144.987103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
12432024-11-28T01:52:41.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 267.380939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
12442024-11-28T01:52:41.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 292.991916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
12452024-11-28T01:52:41.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 208.44137ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
12462024-11-28T01:52:41.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 183.821907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
12472024-11-28T01:52:41.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 124.981427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
12482024-11-28T01:52:41.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 247.621651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
12492024-11-28T01:52:41.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 58.697043ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
12502024-11-28T01:52:41.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 281.580177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
12512024-11-28T01:52:41.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 163.10022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
12522024-11-28T01:52:41.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 199.702143ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
12532024-11-28T01:52:41.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 111.95154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
12542024-11-28T01:52:41.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 134.702512ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
12552024-11-28T01:52:41.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 337.772774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
12562024-11-28T01:52:41.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 241.735499ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
12572024-11-28T01:52:41.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 507.751344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
12582024-11-28T01:52:41.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 206.142952ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
12592024-11-28T01:52:41.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 233.171212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
12602024-11-28T01:52:41.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 200.734706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
12612024-11-28T01:52:41.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 254.590448ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
12622024-11-28T01:52:41.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 468.244788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
12632024-11-28T01:52:41.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 207.365316ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
12642024-11-28T01:52:41.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 259.460813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
12652024-11-28T01:52:41.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 316.949277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
12662024-11-28T01:52:41.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 561.749245ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
12672024-11-28T01:52:41.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 498.919503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
12682024-11-28T01:52:41.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 558.009139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
12692024-11-28T01:52:41.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 246.944438ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
12702024-11-28T01:52:41.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 1.087952001s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
12712024-11-28T01:52:41.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 1.116518647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
12722024-11-28T01:52:41.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 506.322533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
12732024-11-28T01:52:41.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.021189668s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
12742024-11-28T01:52:41.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 590.49628ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
12752024-11-28T01:52:41.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 875.513089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
12762024-11-28T01:52:41.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 602.013921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
12772024-11-28T01:52:41.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 800.031422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
12782024-11-28T01:52:41.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 989.091624ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
12792024-11-28T01:52:41.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 875.590756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
12802024-11-28T01:52:41.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 618.414996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
12812024-11-28T01:52:41.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 414.279395ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
12822024-11-28T01:52:41.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 1.155820671s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
12832024-11-28T01:52:42.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 484.803249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
12842024-11-28T01:52:42.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.399994593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
12852024-11-28T01:52:42.188ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.546260791s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
12862024-11-28T01:52:42.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 1.371220839s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
12872024-11-28T01:52:42.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.292175308s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
12882024-11-28T01:52:42.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 1.11299204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
12892024-11-28T01:52:42.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 962.958512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
12902024-11-28T01:52:42.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 1.207406463s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
12912024-11-28T01:52:42.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 1.245164165s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
12922024-11-28T01:52:42.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 1.028593775s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
12932024-11-28T01:52:42.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 631.645443ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
12942024-11-28T01:52:42.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 1.230832841s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
12952024-11-28T01:52:42.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 570.510129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
12962024-11-28T01:52:42.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 509.501868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
12972024-11-28T01:52:42.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 872.240172ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
12982024-11-28T01:52:43.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 1.106552067s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
12992024-11-28T01:52:43.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 594.278787ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
13002024-11-28T01:52:43.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.061081051s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
13012024-11-28T01:52:43.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 930.638565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
13022024-11-28T01:52:43.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 758.654688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
13032024-11-28T01:52:43.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 1.377882029s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
13042024-11-28T01:52:43.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.373507942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
13052024-11-28T01:52:43.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 771.512407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
13062024-11-28T01:52:43.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 1.427309015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
13072024-11-28T01:52:43.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 1.210545236s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
13082024-11-28T01:52:43.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 1.04222498s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
13092024-11-28T01:52:43.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 1.10922748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
13102024-11-28T01:52:43.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 1.131166486s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
13112024-11-28T01:52:43.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 1.416816569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
13122024-11-28T01:52:43.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 604.476971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
13132024-11-28T01:52:44.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 1.046942473s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
13142024-11-28T01:52:44.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 1.416639993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
13152024-11-28T01:52:44.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 954.287817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
13162024-11-28T01:52:44.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.180487525s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
13172024-11-28T01:52:44.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.359340039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
13182024-11-28T01:52:44.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 882.705644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
13192024-11-28T01:52:44.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 868.993627ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
13202024-11-28T01:52:44.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 1.233100979s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
13212024-11-28T01:52:44.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 719.933007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
13222024-11-28T01:52:44.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 671.112321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
13232024-11-28T01:52:44.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.472548486s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
13242024-11-28T01:52:45.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 750.250934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
13252024-11-28T01:52:45.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 773.841794ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
13262024-11-28T01:52:45.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 1.103044613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
13272024-11-28T01:52:45.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 668.640915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
13282024-11-28T01:52:45.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 1.333420232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
13292024-11-28T01:52:45.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 1.11707237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
13302024-11-28T01:52:45.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.332527619s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
13312024-11-28T01:52:45.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 811.092612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
13322024-11-28T01:52:45.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 616.426815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
13332024-11-28T01:52:45.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 1.341523609s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
13342024-11-28T01:52:45.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 1.392332028s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
13352024-11-28T01:52:45.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.47352732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
13362024-11-28T01:52:45.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 1.344676845s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
13372024-11-28T01:52:45.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 1.045427574s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
13382024-11-28T01:52:45.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 1.210092617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
13392024-11-28T01:52:46.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 865.983894ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
13402024-11-28T01:52:46.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 1.052293047s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
13412024-11-28T01:52:46.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 595.442352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
13422024-11-28T01:52:46.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 657.040371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
13432024-11-28T01:52:46.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 535.280758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
13442024-11-28T01:52:46.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 642.636825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
13452024-11-28T01:52:46.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 1.128783076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
13462024-11-28T01:52:46.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.328474618s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
13472024-11-28T01:52:46.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 858.034759ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
13482024-11-28T01:52:46.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 697.625603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
13492024-11-28T01:52:46.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 1.099339907s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
13502024-11-28T01:52:46.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 1.48615455s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
13512024-11-28T01:52:46.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 1.334334308s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
13522024-11-28T01:52:47.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 1.321277655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
13532024-11-28T01:52:47.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.207379511s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
13542024-11-28T01:52:47.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 1.287444438s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
13552024-11-28T01:52:47.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 637.332191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
13562024-11-28T01:52:47.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.474689716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
13572024-11-28T01:52:47.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 913.047721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
13582024-11-28T01:52:47.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 865.097486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
13592024-11-28T01:52:47.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 625.820188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
13602024-11-28T01:52:47.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 827.558551ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
13612024-11-28T01:52:47.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 719.066034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
13622024-11-28T01:52:47.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 938.281036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
13632024-11-28T01:52:48.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 873.121329ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
13642024-11-28T01:52:48.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 942.417206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
13652024-11-28T01:52:48.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 619.448899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
13662024-11-28T01:52:48.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.21493286s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
13672024-11-28T01:52:48.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 708.535269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
13682024-11-28T01:52:48.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.449725114s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
13692024-11-28T01:52:48.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 624.080694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
13702024-11-28T01:52:48.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 1.26406887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
13712024-11-28T01:52:48.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 806.376044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
13722024-11-28T01:52:48.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 745.465581ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
13732024-11-28T01:52:48.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 1.044130342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
13742024-11-28T01:52:48.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 884.852361ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
13752024-11-28T01:52:48.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 660.863484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
13762024-11-28T01:52:48.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 809.657318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
13772024-11-28T01:52:48.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 700.139559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
13782024-11-28T01:52:48.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 1.449213666s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
13792024-11-28T01:52:48.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 1.034621926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
13802024-11-28T01:52:48.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 932.881366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
13812024-11-28T01:52:49.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 1.496175052s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
13822024-11-28T01:52:49.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 1.45725523s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
13832024-11-28T01:52:49.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 828.632959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
13842024-11-28T01:52:49.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 656.274722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
13852024-11-28T01:52:49.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.290925109s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
13862024-11-28T01:52:49.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 730.947514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
13872024-11-28T01:52:49.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 871.008573ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
13882024-11-28T01:52:49.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 520.29486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
13892024-11-28T01:52:49.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 1.347926126s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
13902024-11-28T01:52:49.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 1.474782265s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
13912024-11-28T01:52:49.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.296753093s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
13922024-11-28T01:52:49.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 671.027312ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
13932024-11-28T01:52:50.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 642.955985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
13942024-11-28T01:52:50.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 738.524327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
13952024-11-28T01:52:50.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 918.60103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
13962024-11-28T01:52:50.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 1.378410002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
13972024-11-28T01:52:50.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 515.625206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
13982024-11-28T01:52:50.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 756.321322ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
13992024-11-28T01:52:50.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 1.451717591s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
14002024-11-28T01:52:50.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 926.456083ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
14012024-11-28T01:52:50.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 1.303274038s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
14022024-11-28T01:52:50.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 1.46381483s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
14032024-11-28T01:52:50.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 72.33216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
14042024-11-28T01:52:50.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.242087645s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
14052024-11-28T01:52:50.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 628.30546ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
14062024-11-28T01:52:50.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 56.316345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
14072024-11-28T01:52:50.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 1.435716107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
14082024-11-28T01:52:50.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 51.53911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
14092024-11-28T01:52:50.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 916.777609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
14102024-11-28T01:52:50.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 61.150361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
14112024-11-28T01:52:50.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 142.725341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
14122024-11-28T01:52:50.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 204.675406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
14132024-11-28T01:52:50.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 849.763433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
14142024-11-28T01:52:50.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 360.335491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
14152024-11-28T01:52:51.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 1.079252812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
14162024-11-28T01:52:51.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 550.094335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
14172024-11-28T01:52:51.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 774.916431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
14182024-11-28T01:52:51.098ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14192024-11-28T01:52:51.099ZINFOSledAgent (ServiceManager): Booting oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
14202024-11-28T01:52:51.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 1.439858205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
14212024-11-28T01:52:51.113ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14222024-11-28T01:52:51.127ZINFOSledAgent (ServiceManager): Booting oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
14232024-11-28T01:52:51.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 540.020708ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
14242024-11-28T01:52:51.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 25.303417ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
14252024-11-28T01:52:51.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 41.573062ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
14262024-11-28T01:52:51.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.302841311s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
14272024-11-28T01:52:51.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 104.703167ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
14282024-11-28T01:52:51.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 589.396107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
14292024-11-28T01:52:51.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 139.828626ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
14302024-11-28T01:52:51.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 180.752325ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
14312024-11-28T01:52:51.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 784.818411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
14322024-11-28T01:52:51.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 627.090986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
14332024-11-28T01:52:51.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 240.129343ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
14342024-11-28T01:52:51.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 1.061689189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
14352024-11-28T01:52:51.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 391.1478ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
14362024-11-28T01:52:51.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 1.188379227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
14372024-11-28T01:52:51.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 1.385600528s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
14382024-11-28T01:52:51.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 251.805635ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
14392024-11-28T01:52:51.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 524.052479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
14402024-11-28T01:52:51.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 1.175284158s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
14412024-11-28T01:52:51.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.133791904s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
14422024-11-28T01:52:51.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 665.822244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
14432024-11-28T01:52:51.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 973.254679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
14442024-11-28T01:52:51.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 888.473935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
14452024-11-28T01:52:52.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 497.947161ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
14462024-11-28T01:52:52.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 650.834675ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
14472024-11-28T01:52:52.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 1.051405361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
14482024-11-28T01:52:52.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 928.260156ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
14492024-11-28T01:52:52.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 562.875504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
14502024-11-28T01:52:52.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 1.319427387s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
14512024-11-28T01:52:52.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 1.497441464s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
14522024-11-28T01:52:52.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 580.14407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
14532024-11-28T01:52:52.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 999.727602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
14542024-11-28T01:52:52.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 958.337514ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
14552024-11-28T01:52:52.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 1.063503718s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
14562024-11-28T01:52:52.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.406178424s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
14572024-11-28T01:52:52.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 1.49282763s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
14582024-11-28T01:52:52.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 1.032617476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
14592024-11-28T01:52:52.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 912.545924ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
14602024-11-28T01:52:52.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 778.369092ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
14612024-11-28T01:52:52.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 529.375672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
14622024-11-28T01:52:52.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.313468163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
14632024-11-28T01:52:52.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 1.130281405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
14642024-11-28T01:52:53.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.197904183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
14652024-11-28T01:52:53.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 1.023429812s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
14662024-11-28T01:52:53.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 1.340907065s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
14672024-11-28T01:52:53.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 729.267773ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
14682024-11-28T01:52:53.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 587.874911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
14692024-11-28T01:52:53.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 1.066038381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
14702024-11-28T01:52:53.470ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14712024-11-28T01:52:53.470ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
14722024-11-28T01:52:53.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 954.395636ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
14732024-11-28T01:52:53.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 1.237383736s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
14742024-11-28T01:52:53.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 615.868147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
14752024-11-28T01:52:53.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 1.027138897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
14762024-11-28T01:52:53.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 938.145428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
14772024-11-28T01:52:53.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 713.957477ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
14782024-11-28T01:52:53.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 49.729256ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
14792024-11-28T01:52:53.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 549.078676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
14802024-11-28T01:52:53.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 1.490120219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
14812024-11-28T01:52:53.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 790.296264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
14822024-11-28T01:52:53.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 140.947557ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
14832024-11-28T01:52:53.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 1.260668215s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
14842024-11-28T01:52:54.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 232.763362ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
14852024-11-28T01:52:54.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 969.852826ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
14862024-11-28T01:52:54.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 1.321179204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
14872024-11-28T01:52:54.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.299669653s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
14882024-11-28T01:52:54.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 850.163104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
14892024-11-28T01:52:54.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 1.47858871s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
14902024-11-28T01:52:54.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 593.395913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
14912024-11-28T01:52:54.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.453062241s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
14922024-11-28T01:52:54.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 362.010196ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
14932024-11-28T01:52:54.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 1.478778912s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
14942024-11-28T01:52:54.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 861.575432ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
14952024-11-28T01:52:54.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 1.205367554s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
14962024-11-28T01:52:54.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 1.030432793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
14972024-11-28T01:52:54.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 1.333653828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
14982024-11-28T01:52:54.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 1.310259302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
14992024-11-28T01:52:54.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 1.234145707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
15002024-11-28T01:52:54.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 985.413098ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
15012024-11-28T01:52:54.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 1.376039667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
15022024-11-28T01:52:54.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 1.160718847s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
15032024-11-28T01:52:54.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 885.223199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
15042024-11-28T01:52:55.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 1.252764884s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
15052024-11-28T01:52:55.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 883.76149ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
15062024-11-28T01:52:55.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 813.051296ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
15072024-11-28T01:52:55.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 1.478117429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
15082024-11-28T01:52:55.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 1.368035872s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
15092024-11-28T01:52:55.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 689.136811ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
15102024-11-28T01:52:55.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 873.351021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
15112024-11-28T01:52:55.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 1.227987547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
15122024-11-28T01:52:55.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 1.378353256s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
15132024-11-28T01:52:55.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 1.422743513s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
15142024-11-28T01:52:55.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 837.009262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
15152024-11-28T01:52:55.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.125875327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
15162024-11-28T01:52:55.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.137461952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
15172024-11-28T01:52:55.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 737.007144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
15182024-11-28T01:52:55.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 1.00217563s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
15192024-11-28T01:52:55.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 980.517211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
15202024-11-28T01:52:55.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 831.727925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
15212024-11-28T01:52:55.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 1.277646674s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
15222024-11-28T01:52:55.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 972.16123ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
15232024-11-28T01:52:56.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 1.0401401s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
15242024-11-28T01:52:56.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 1.474895409s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
15252024-11-28T01:52:56.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.056253406s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
15262024-11-28T01:52:56.132ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63388
15272024-11-28T01:52:56.153ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1726 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63388 req_id = a74c998f-5135-4627-9a4c-0f58e2dd3d96 response_code = 200 uri = /baseboard
15282024-11-28T01:52:56.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 651.580998ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
15292024-11-28T01:52:56.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 1.192962004s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
15302024-11-28T01:52:56.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 684.126891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
15312024-11-28T01:52:56.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 1.258885147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
15322024-11-28T01:52:56.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 954.325448ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
15332024-11-28T01:52:56.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 1.095113494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
15342024-11-28T01:52:56.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 515.424531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
15352024-11-28T01:52:56.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 1.110632976s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
15362024-11-28T01:52:56.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.226795028s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
15372024-11-28T01:52:56.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 986.93757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
15382024-11-28T01:52:56.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 1.038898257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
15392024-11-28T01:52:56.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.487780499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
15402024-11-28T01:52:56.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 1.262575029s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
15412024-11-28T01:52:56.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 792.001096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
15422024-11-28T01:52:57.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 851.310495ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
15432024-11-28T01:52:57.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 972.350424ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
15442024-11-28T01:52:57.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 980.493633ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
15452024-11-28T01:52:57.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 918.03637ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
15462024-11-28T01:52:57.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 929.417276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
15472024-11-28T01:52:57.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 1.409129797s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
15482024-11-28T01:52:57.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 725.253446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
15492024-11-28T01:52:57.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 1.481832393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
15502024-11-28T01:52:57.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 678.320922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
15512024-11-28T01:52:57.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 1.370357308s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
15522024-11-28T01:52:57.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 1.131644002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
15532024-11-28T01:52:57.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 1.034801839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
15542024-11-28T01:52:57.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 570.236066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
15552024-11-28T01:52:57.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 986.570731ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
15562024-11-28T01:52:57.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 570.602834ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
15572024-11-28T01:52:57.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 954.90053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
15582024-11-28T01:52:57.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 881.180226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
15592024-11-28T01:52:58.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 590.394517ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
15602024-11-28T01:52:58.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f") failed: Property not found. retry in 1.269677551s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
15612024-11-28T01:52:58.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 1.258480979s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
15622024-11-28T01:52:58.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.427832409s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
15632024-11-28T01:52:58.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 550.628357ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
15642024-11-28T01:52:58.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 500.161288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
15652024-11-28T01:52:58.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 1.48661978s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
15662024-11-28T01:52:58.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 1.039302585s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
15672024-11-28T01:52:58.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.445680243s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
15682024-11-28T01:52:58.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 1.294875567s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
15692024-11-28T01:52:58.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 1.490847201s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
15702024-11-28T01:52:58.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 958.454485ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
15712024-11-28T01:52:58.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 1.286452645s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
15722024-11-28T01:52:58.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.029362656s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
15732024-11-28T01:52:58.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 504.240331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
15742024-11-28T01:52:58.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 520.517277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
15752024-11-28T01:52:58.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86") failed: Property not found. retry in 1.339850955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
15762024-11-28T01:52:58.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 858.796369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
15772024-11-28T01:52:58.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 579.563656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
15782024-11-28T01:52:58.915ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.050912578s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
15792024-11-28T01:52:58.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 812.92788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
15802024-11-28T01:52:59.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9") failed: Property not found. retry in 776.269744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
15812024-11-28T01:52:59.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 785.371513ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
15822024-11-28T01:52:59.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 635.812525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
15832024-11-28T01:52:59.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 1.085708439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
15842024-11-28T01:52:59.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 1.348277672s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
15852024-11-28T01:52:59.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 524.769417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
15862024-11-28T01:52:59.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df") failed: Property not found. retry in 1.483304943s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
15872024-11-28T01:52:59.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 523.051527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
15882024-11-28T01:52:59.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5") failed: Property not found. retry in 1.378812094s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
15892024-11-28T01:52:59.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905") failed: Property not found. retry in 1.134902572s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
15902024-11-28T01:52:59.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf") failed: Property not found. retry in 1.113949639s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
15912024-11-28T01:52:59.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c") failed: Property not found. retry in 1.189786075s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
15922024-11-28T01:52:59.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178") failed: Property not found. retry in 944.197968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
15932024-11-28T01:52:59.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0") failed: Property not found. retry in 1.402763133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
15942024-11-28T01:52:59.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 546.431117ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
15952024-11-28T01:52:59.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd") failed: Property not found. retry in 1.115167895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
15962024-11-28T01:52:59.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026") failed: Property not found. retry in 827.479078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
15972024-11-28T01:52:59.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133") failed: Property not found. retry in 644.239063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
15982024-11-28T01:52:59.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 680.428484ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
15992024-11-28T01:53:00.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17") failed: Property not found. retry in 1.44465945s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
16002024-11-28T01:53:00.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215") failed: Property not found. retry in 1.274703854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
16012024-11-28T01:53:00.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1") failed: Property not found. retry in 1.4196113s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
16022024-11-28T01:53:00.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00") failed: Property not found. retry in 893.099758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
16032024-11-28T01:53:00.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc") failed: Property not found. retry in 510.450203ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
16042024-11-28T01:53:00.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 741.792838ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
16052024-11-28T01:53:01.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 865.221757ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
16062024-11-28T01:53:02.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8") failed: Property not found. retry in 505.367597ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
16072024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_b334fd6a-2b27-4fad-b63a-4bb44c2464e8
16082024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_36d4f615-7461-4364-960c-89ece3aaabaf
16092024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_2469a748-bcd2-4e0d-99cc-f79def0452cc
16102024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_eae490d2-fe44-4810-8815-063375ca7e2f
16112024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_07b822d0-10f3-42de-b0a1-53274571b215
16122024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_5ecc5ab3-da37-4a7a-9abe-dff407cafb00
16132024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_4f0fafe9-6076-4543-9e44-d38b39ebb133
16142024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_119eed64-2e24-4d5f-8c42-be6cd8bec8b5
16152024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_6392fcec-0540-4c8e-8fb9-a456637e79d1
16162024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_5852adb9-5a7e-47cf-a1f4-e3f69c698ecd
16172024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_c443e40c-7868-4dfc-9621-c787f7207178
16182024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_d24eaff3-a59b-4fb7-89de-6ce285942026
16192024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_81e8c1b0-db2f-4eb4-ba08-7718441bf3df
16202024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_2d033909-79ed-49ae-b11d-aeb32740cc17
16212024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_03aeb984-bba8-42eb-8614-cb86e5580f86
16222024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_c4172b9e-1bf8-491e-8277-58af196d34c0
16232024-11-28T01:53:02.950ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_f0b1e661-688b-4f1f-b5d2-cc2c76439d4c
16242024-11-28T01:53:02.951ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_9b7575ba-25d1-4f2b-9b6d-c343e20cf3f9
16252024-11-28T01:53:02.951ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_eb274350-c0b0-4bce-9c8a-502880f2c905
16262024-11-28T01:53:02.952ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16272024-11-28T01:53:02.957ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16282024-11-28T01:53:02.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36852532 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60395 req_id = 7b2feaca-75ee-417d-aad4-bb113ff27a4c response_code = 204 uri = /omicron-zones
16292024-11-28T01:53:02.971ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1435
16302024-11-28T01:53:02.973ZINFOSledAgent (RSS): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16312024-11-28T01:53:02.973ZINFOSledAgent (RSS): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16322024-11-28T01:53:03.152ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:774
16332024-11-28T01:53:03.159ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:786
16342024-11-28T01:53:03.207ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1000
16352024-11-28T01:53:04.366ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.123317566s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
16362024-11-28T01:53:04.366ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16372024-11-28T01:53:04.458ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16382024-11-28T01:53:04.608ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16392024-11-28T01:53:04.775ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16402024-11-28T01:53:04.870ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16412024-11-28T01:53:05.049ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16422024-11-28T01:53:05.236ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16432024-11-28T01:53:05.453ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16442024-11-28T01:53:05.902ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16452024-11-28T01:53:06.339ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16462024-11-28T01:53:06.790ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16472024-11-28T01:53:07.133ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16482024-11-28T01:53:08.172ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/92a8ff6e-21d3-4c28-bcad-e323847985dc/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
16492024-11-28T01:53:09.079ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6e1b2697-c690-40cf-a6e1-fc23b8d68940", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"92a8ff6e-21d3-4c28-bcad-e323847985dc\"", request_id: "6e1b2697-c690-40cf-a6e1-fc23b8d68940" } file = sled-agent/src/rack_setup/service.rs:1062
16502024-11-28T01:53:10.380ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7b8296d4-4c59-4134-81da-e4fedf677184", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"92a8ff6e-21d3-4c28-bcad-e323847985dc\"", request_id: "7b8296d4-4c59-4134-81da-e4fedf677184" } file = sled-agent/src/rack_setup/service.rs:1062
16512024-11-28T01:53:12.264ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3febe310-13fd-4186-bb41-c8896b47842c", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:12 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"313847b3-d670-4167-9b09-9e7d3dfcb2a4\"", request_id: "3febe310-13fd-4186-bb41-c8896b47842c" } file = sled-agent/src/rack_setup/service.rs:1062
16522024-11-28T01:53:13.750ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "423703c2-48d9-4077-b60b-e21ac1fa33eb", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"313847b3-d670-4167-9b09-9e7d3dfcb2a4\"", request_id: "423703c2-48d9-4077-b60b-e21ac1fa33eb" } file = sled-agent/src/rack_setup/service.rs:1062
16532024-11-28T01:53:16.293ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "028f126b-7d77-4038-abe1-9ca698a4fc5c", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"313847b3-d670-4167-9b09-9e7d3dfcb2a4\"", request_id: "028f126b-7d77-4038-abe1-9ca698a4fc5c" } file = sled-agent/src/rack_setup/service.rs:1062
16542024-11-28T01:53:18.425ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9e196de1-e299-412f-a884-21bbe9037177", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"313847b3-d670-4167-9b09-9e7d3dfcb2a4\"", request_id: "9e196de1-e299-412f-a884-21bbe9037177" } file = sled-agent/src/rack_setup/service.rs:1062
16552024-11-28T01:53:20.860ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c3c0db2a-6c8b-49d9-b817-067c3d15dbd9", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"313847b3-d670-4167-9b09-9e7d3dfcb2a4\"", request_id: "c3c0db2a-6c8b-49d9-b817-067c3d15dbd9" } file = sled-agent/src/rack_setup/service.rs:1062
16562024-11-28T01:53:22.735ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ba67ac66-fa5c-4da9-ae6b-4b0179592eae", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:22 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"313847b3-d670-4167-9b09-9e7d3dfcb2a4\"", request_id: "ba67ac66-fa5c-4da9-ae6b-4b0179592eae" } file = sled-agent/src/rack_setup/service.rs:1062
16572024-11-28T01:53:24.515ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:57643 remote_addr = [fd00:1122:3344:101::d]:39115 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
16582024-11-28T01:53:24.540ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23449 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 26a1877c-7939-4831-8216-9e5269ec1e1f response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
16592024-11-28T01:53:25.955ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9ddf6807-eee8-4aa2-a8ad-36f14b205a76", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"313847b3-d670-4167-9b09-9e7d3dfcb2a4\"", request_id: "9ddf6807-eee8-4aa2-a8ad-36f14b205a76" } file = sled-agent/src/rack_setup/service.rs:1062
16602024-11-28T01:53:26.188ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35901
16612024-11-28T01:53:26.188ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35901 req_id = a4f60d3a-d68f-4109-b96a-53785f28e208 response_code = 200 uri = /baseboard
16622024-11-28T01:53:28.917ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "bc4388fb-db73-4ab1-9a62-2f3e92e1444e", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"313847b3-d670-4167-9b09-9e7d3dfcb2a4\"", request_id: "bc4388fb-db73-4ab1-9a62-2f3e92e1444e" } file = sled-agent/src/rack_setup/service.rs:1062
16632024-11-28T01:53:35.953ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a60bf765-a162-4924-a974-1b2294fd0d0d", "content-length": "173", "date": "Thu, 28 Nov 2024 01:53:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"313847b3-d670-4167-9b09-9e7d3dfcb2a4\"", request_id: "a60bf765-a162-4924-a974-1b2294fd0d0d" } file = sled-agent/src/rack_setup/service.rs:1062
16642024-11-28T01:53:42.393ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
16652024-11-28T01:53:42.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37619
16662024-11-28T01:53:42.484ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16672024-11-28T01:53:42.484ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16682024-11-28T01:53:42.485ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:177
16692024-11-28T01:53:42.489ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:177
16702024-11-28T01:53:42.506ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16712024-11-28T01:53:42.506ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_89678a9e-6cf0-40f7-a395-8631085163d8
16722024-11-28T01:53:42.531ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16732024-11-28T01:53:42.531ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69
16742024-11-28T01:53:42.555ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16752024-11-28T01:53:42.555ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_830b5e11-e6e4-4144-bc16-2396db6d872e
16762024-11-28T01:53:42.578ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16772024-11-28T01:53:42.578ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8
16782024-11-28T01:53:42.600ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16792024-11-28T01:53:42.600ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be
16802024-11-28T01:53:42.620ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16812024-11-28T01:53:42.620ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c9996824-866a-4451-99ce-f11f76d585ed
16822024-11-28T01:53:42.640ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16832024-11-28T01:53:42.640ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa
16842024-11-28T01:53:42.659ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16852024-11-28T01:53:42.659ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_60dc1266-4525-4b36-849d-835d2a02f170
16862024-11-28T01:53:42.681ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16872024-11-28T01:53:42.681ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67
16882024-11-28T01:53:42.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37619 req_id = a2aba37d-bfeb-41f5-8398-93d1c4b95728 response_code = 200 uri = /inventory
16892024-11-28T01:53:43.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46647
16902024-11-28T01:53:43.640ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16912024-11-28T01:53:43.641ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16922024-11-28T01:53:43.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16932024-11-28T01:53:43.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16942024-11-28T01:53:43.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16952024-11-28T01:53:43.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16962024-11-28T01:53:43.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16972024-11-28T01:53:43.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8796 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46647 req_id = b778a93e-0aa7-4a61-bd25-eb11750775c6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16982024-11-28T01:53:43.643ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1072
16992024-11-28T01:53:43.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56128
17002024-11-28T01:53:43.826ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17012024-11-28T01:53:43.826ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17022024-11-28T01:53:43.826ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:177
17032024-11-28T01:53:43.826ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:177
17042024-11-28T01:53:43.838ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17052024-11-28T01:53:43.838ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_89678a9e-6cf0-40f7-a395-8631085163d8
17062024-11-28T01:53:43.862ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17072024-11-28T01:53:43.862ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69
17082024-11-28T01:53:43.885ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17092024-11-28T01:53:43.886ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_830b5e11-e6e4-4144-bc16-2396db6d872e
17102024-11-28T01:53:43.907ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17112024-11-28T01:53:43.907ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8
17122024-11-28T01:53:43.927ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17132024-11-28T01:53:43.927ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be
17142024-11-28T01:53:43.948ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17152024-11-28T01:53:43.948ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c9996824-866a-4451-99ce-f11f76d585ed
17162024-11-28T01:53:43.967ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17172024-11-28T01:53:43.968ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa
17182024-11-28T01:53:43.988ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17192024-11-28T01:53:43.988ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_60dc1266-4525-4b36-849d-835d2a02f170
17202024-11-28T01:53:44.007ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17212024-11-28T01:53:44.008ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67
17222024-11-28T01:53:44.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56128 req_id = 3513ded1-633c-45a2-9dbf-54f5058e7d11 response_code = 200 uri = /inventory
17232024-11-28T01:53:44.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65028
17242024-11-28T01:53:44.850ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17252024-11-28T01:53:44.850ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17262024-11-28T01:53:44.850ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17272024-11-28T01:53:44.850ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17282024-11-28T01:53:44.850ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17292024-11-28T01:53:44.850ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17302024-11-28T01:53:44.851ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17312024-11-28T01:53:44.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65028 req_id = 1352748e-16d2-4840-b633-e10667ec33d2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17322024-11-28T01:53:44.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62465
17332024-11-28T01:53:44.905ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17342024-11-28T01:53:44.905ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17352024-11-28T01:53:44.905ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17362024-11-28T01:53:44.905ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17372024-11-28T01:53:44.905ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17382024-11-28T01:53:44.905ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17392024-11-28T01:53:44.905ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17402024-11-28T01:53:44.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 812 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62465 req_id = 4b73f33d-e63f-4307-9226-d7e2369f80a3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17412024-11-28T01:53:44.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55350
17422024-11-28T01:53:44.952ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17432024-11-28T01:53:44.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17442024-11-28T01:53:44.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17452024-11-28T01:53:44.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17462024-11-28T01:53:44.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17472024-11-28T01:53:44.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17482024-11-28T01:53:44.952ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17492024-11-28T01:53:44.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55350 req_id = 350e747f-740b-4709-b4c9-33b92f2ca066 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17502024-11-28T01:53:51.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54596
17512024-11-28T01:53:51.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 538 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54596 req_id = cc43a2de-5c4d-4dde-bdf3-c71b3177f141 response_code = 200 uri = /vpc-routes
17522024-11-28T01:53:51.061ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
17532024-11-28T01:53:51.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54596 req_id = cc89bd86-70e8-4121-853f-cffb573dd6f9 response_code = 204 uri = /eip-gateways
17542024-11-28T01:53:51.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4500 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54596 req_id = 91c7ae2a-bb05-4676-a54f-2014561c2a3f response_code = 204 uri = /vpc-routes
17552024-11-28T01:53:54.231ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8280 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 92ea325b-988a-43a7-93c5-11693bcb3a75 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
17562024-11-28T01:53:56.224ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47208
17572024-11-28T01:53:56.224ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47208 req_id = 33c3d587-df65-4842-96d2-8b2209472f55 response_code = 200 uri = /baseboard
17582024-11-28T01:54:10.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58739
17592024-11-28T01:54:10.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58739 req_id = 6f8cdf3a-1fd8-4aad-8e89-e9a71283c7e1 response_code = 200 uri = /vpc-routes
17602024-11-28T01:54:10.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45586
17612024-11-28T01:54:10.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45586 req_id = 3a8f7a3d-7073-46ee-8a8c-a211ef76b5f7 response_code = 200 uri = /v2p
17622024-11-28T01:54:10.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
17632024-11-28T01:54:10.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58739 req_id = 97ff95b9-885b-46b8-b1db-62996c4459b0 response_code = 204 uri = /eip-gateways
17642024-11-28T01:54:10.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58739 req_id = 26ad7d6b-7a6f-4ef8-bed1-bd565be9236d response_code = 204 uri = /vpc-routes
17652024-11-28T01:54:10.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34004
17662024-11-28T01:54:10.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34004 req_id = 7f22448e-1e1e-4fd4-9238-e468c1029ef4 response_code = 200 uri = /vpc-routes
17672024-11-28T01:54:10.916ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
17682024-11-28T01:54:10.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34004 req_id = 30b84cf4-4d41-4741-885d-903eaa57064c response_code = 204 uri = /eip-gateways
17692024-11-28T01:54:10.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34004 req_id = d350e5a1-dc28-433f-adf1-94af74b1e9d9 response_code = 204 uri = /vpc-routes
17702024-11-28T01:54:10.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57841
17712024-11-28T01:54:10.943ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17722024-11-28T01:54:11.038ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17732024-11-28T01:54:11.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166430 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57841 req_id = 62ab26e6-9504-4ca8-8c4e-0ed4cf8c287e response_code = 204 uri = /switch-ports
17742024-11-28T01:54:11.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64313
17752024-11-28T01:54:11.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56159
17762024-11-28T01:54:11.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56159 req_id = 32c8a17e-0580-4da0-8e5f-9622445547a7 response_code = 200 uri = /vpc-routes
17772024-11-28T01:54:11.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1002 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64313 req_id = b3761a05-707c-4b93-99af-da5fd1222779 response_code = 200 uri = /v2p
17782024-11-28T01:54:11.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57841 req_id = 1ed32993-04b5-4fa3-b27f-1338f9a70832 response_code = 200 uri = /network-bootstore-config
17792024-11-28T01:54:11.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59278
17802024-11-28T01:54:11.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59278 req_id = d346cd4b-9174-4d32-97c4-74bbbf276a93 response_code = 200 uri = /v2p
17812024-11-28T01:54:11.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44992
17822024-11-28T01:54:11.143ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17832024-11-28T01:54:11.193ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17842024-11-28T01:54:11.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44992 req_id = e5c60251-d2a9-4c15-b140-234b78d24d33 response_code = 204 uri = /switch-ports
17852024-11-28T01:54:11.255ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
17862024-11-28T01:54:11.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56159 req_id = 508ec8b0-1099-45ea-9139-9a42a2cf1a66 response_code = 204 uri = /eip-gateways
17872024-11-28T01:54:11.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44992 req_id = a751b95b-f18d-4dc9-8714-b1c0b6db2c1d response_code = 200 uri = /network-bootstore-config
17882024-11-28T01:54:11.257ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17892024-11-28T01:54:11.258ZINFOSledAgent (bootstore): Writing ledger to /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17902024-11-28T01:54:11.263ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17912024-11-28T01:54:11.263ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17922024-11-28T01:54:11.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57841 req_id = fc7ba664-855b-472c-84e2-df1a7eabb726 response_code = 204 uri = /network-bootstore-config
17932024-11-28T01:54:11.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56159 req_id = cc3e749b-68fe-49bf-a500-790e2334dafa response_code = 204 uri = /vpc-routes
17942024-11-28T01:54:11.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57105
17952024-11-28T01:54:11.312ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17962024-11-28T01:54:11.348ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17972024-11-28T01:54:11.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57105 req_id = 069ecac1-4bbe-4937-9da5-b1e2b85a4fb0 response_code = 204 uri = /switch-ports
17982024-11-28T01:54:11.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57105 req_id = 7b524676-72ec-4002-a989-e1ab6ae6916c response_code = 200 uri = /network-bootstore-config
17992024-11-28T01:54:24.201ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7021 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = d75599f2-5142-4a4a-a295-575140a91776 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
18002024-11-28T01:54:26.258ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43509
18012024-11-28T01:54:26.258ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43509 req_id = f9db9ac6-7219-44a9-99e5-c48245c10142 response_code = 200 uri = /baseboard
18022024-11-28T01:54:40.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51802
18032024-11-28T01:54:40.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51802 req_id = f608cc24-00de-4ca1-ba34-f756aaf126a0 response_code = 200 uri = /vpc-routes
18042024-11-28T01:54:40.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59874
18052024-11-28T01:54:40.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59874 req_id = 8cde42a2-84d2-43a4-adfa-41e09f6529b8 response_code = 200 uri = /vpc-routes
18062024-11-28T01:54:40.680ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
18072024-11-28T01:54:40.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51802 req_id = 63db20ea-83f7-40d0-bb0b-0f1472cf3537 response_code = 204 uri = /eip-gateways
18082024-11-28T01:54:40.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51802 req_id = 85b3481d-511d-4fd9-a34c-add8fffd2580 response_code = 204 uri = /vpc-routes
18092024-11-28T01:54:40.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51267
18102024-11-28T01:54:40.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51267 req_id = 7b3701ad-c7f3-4fb8-8b38-d341938b3389 response_code = 200 uri = /v2p
18112024-11-28T01:54:40.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
18122024-11-28T01:54:40.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59874 req_id = 7bdc934f-8af9-473b-b556-1cc4f9b9d90b response_code = 204 uri = /eip-gateways
18132024-11-28T01:54:40.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59874 req_id = 11c0221d-ef42-4bea-a7a0-3e0e92721d36 response_code = 204 uri = /vpc-routes
18142024-11-28T01:54:40.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55908
18152024-11-28T01:54:40.784ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18162024-11-28T01:54:40.823ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18172024-11-28T01:54:40.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97196 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55908 req_id = bda8b860-105d-46db-bc9c-4d1613c262e3 response_code = 204 uri = /switch-ports
18182024-11-28T01:54:40.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55054
18192024-11-28T01:54:40.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61086
18202024-11-28T01:54:40.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61124
18212024-11-28T01:54:40.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61124 req_id = 7c88b3bf-4653-4a86-9d00-0844ae804546 response_code = 200 uri = /vpc-routes
18222024-11-28T01:54:40.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55908 req_id = 33b70271-e62b-484a-82b4-fc5dead9a723 response_code = 200 uri = /network-bootstore-config
18232024-11-28T01:54:40.882ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18242024-11-28T01:54:40.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61086 req_id = d5a3bb74-d7c1-4c6a-a366-de8baafbac40 response_code = 200 uri = /v2p
18252024-11-28T01:54:40.927ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18262024-11-28T01:54:40.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
18272024-11-28T01:54:40.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61124 req_id = dd4e74c1-749e-4f7b-ada1-df44c15dee9e response_code = 204 uri = /eip-gateways
18282024-11-28T01:54:40.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61124 req_id = d5015b5f-37df-4330-b6c4-b4007891532e response_code = 204 uri = /vpc-routes
18292024-11-28T01:54:40.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40620
18302024-11-28T01:54:40.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40620 req_id = 68c5a604-a3ad-439c-af71-cd6ee0394ef6 response_code = 200 uri = /v2p
18312024-11-28T01:54:40.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102581 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55054 req_id = 61ea1c8f-9572-40cf-b442-9fe7dec8531b response_code = 204 uri = /switch-ports
18322024-11-28T01:54:40.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55054 req_id = 8afbfe4a-8391-4caa-95f4-dd9004dab617 response_code = 200 uri = /network-bootstore-config
18332024-11-28T01:54:41.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49830
18342024-11-28T01:54:41.119ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18352024-11-28T01:54:41.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18362024-11-28T01:54:41.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92647 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49830 req_id = a3fa0aff-1178-42c5-9ee0-71f31f961b5f response_code = 204 uri = /switch-ports
18372024-11-28T01:54:41.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49830 req_id = 6993a44f-2846-46ae-a3df-975a0b750070 response_code = 200 uri = /network-bootstore-config
18382024-11-28T01:54:54.202ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7791 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 604a308c-15d7-405d-a748-5b3797d93c38 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
18392024-11-28T01:54:56.289ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49721
18402024-11-28T01:54:56.289ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49721 req_id = 3b3c5b46-40ce-42de-9bab-409c15a1ff30 response_code = 200 uri = /baseboard
18412024-11-28T01:55:10.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43452
18422024-11-28T01:55:10.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43452 req_id = 5ed014a6-b303-49fa-86ed-9b9168771bca response_code = 200 uri = /v2p
18432024-11-28T01:55:10.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33867
18442024-11-28T01:55:10.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33867 req_id = 38e79684-ee1b-464d-a4af-8de0a624807f response_code = 200 uri = /vpc-routes
18452024-11-28T01:55:10.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49554
18462024-11-28T01:55:10.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49554 req_id = 230dd99a-d8bf-4144-af40-ded1b4376d1f response_code = 200 uri = /vpc-routes
18472024-11-28T01:55:10.870ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
18482024-11-28T01:55:10.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33867 req_id = 553ff589-3ea5-4e4f-acd3-a24eadb214d5 response_code = 204 uri = /eip-gateways
18492024-11-28T01:55:10.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33867 req_id = 4a944970-0010-4611-8c58-4e1628943497 response_code = 204 uri = /vpc-routes
18502024-11-28T01:55:10.888ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
18512024-11-28T01:55:10.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49554 req_id = 3850db34-2729-47c5-8e68-9b027d870b6b response_code = 204 uri = /eip-gateways
18522024-11-28T01:55:10.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41433
18532024-11-28T01:55:10.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41433 req_id = b9cf45a8-07e4-4794-97b3-6970de29ae2a response_code = 200 uri = /v2p
18542024-11-28T01:55:10.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49554 req_id = d23b9c4e-1de5-4c94-9c5d-125deeae8a15 response_code = 204 uri = /vpc-routes
18552024-11-28T01:55:11.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37404
18562024-11-28T01:55:11.048ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18572024-11-28T01:55:11.089ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18582024-11-28T01:55:11.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109754 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37404 req_id = 541fe26b-645e-42ae-98ad-e18c43559344 response_code = 204 uri = /switch-ports
18592024-11-28T01:55:11.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37468
18602024-11-28T01:55:11.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59881
18612024-11-28T01:55:11.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37468 req_id = 173a1d77-3bc2-43fb-8304-b9f298b0278c response_code = 200 uri = /vpc-routes
18622024-11-28T01:55:11.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37404 req_id = 200dbbee-21ca-40fd-b05c-211cde0ce9e3 response_code = 200 uri = /network-bootstore-config
18632024-11-28T01:55:11.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18642024-11-28T01:55:11.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18652024-11-28T01:55:11.209ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
18662024-11-28T01:55:11.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37468 req_id = d68cc686-e791-4ec9-92dd-43d6586fc8b5 response_code = 204 uri = /eip-gateways
18672024-11-28T01:55:11.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52548
18682024-11-28T01:55:11.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52548 req_id = 76ddd47d-9064-40c1-913f-69f3217cf5f0 response_code = 200 uri = /v2p
18692024-11-28T01:55:11.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 497 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37468 req_id = dd2cabd3-e1ff-4e7f-979a-cc2d63dbab89 response_code = 204 uri = /vpc-routes
18702024-11-28T01:55:11.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105466 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59881 req_id = 165648b4-1a33-4b60-ac46-131ebee4da65 response_code = 204 uri = /switch-ports
18712024-11-28T01:55:11.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59881 req_id = f056fafa-af14-4579-b3ec-38835e3f36b2 response_code = 200 uri = /network-bootstore-config
18722024-11-28T01:55:11.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37052
18732024-11-28T01:55:11.323ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18742024-11-28T01:55:11.361ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18752024-11-28T01:55:11.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37052 req_id = f64e0717-fd08-407d-9134-c2b80b3df258 response_code = 204 uri = /switch-ports
18762024-11-28T01:55:11.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37052 req_id = b50f210d-9d3d-483a-bb4b-919626414b46 response_code = 200 uri = /network-bootstore-config
18772024-11-28T01:55:24.203ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8315 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 213db3da-86c8-4f41-bf4d-405e8695234d response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
18782024-11-28T01:55:26.326ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49320
18792024-11-28T01:55:26.327ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49320 req_id = 442aeec6-524a-4f28-b388-327eb36afed7 response_code = 200 uri = /baseboard
18802024-11-28T01:55:40.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62560
18812024-11-28T01:55:40.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62560 req_id = 3c64b492-4ff4-478b-b055-9c61ce56eb8d response_code = 200 uri = /vpc-routes
18822024-11-28T01:55:40.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44280
18832024-11-28T01:55:40.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44280 req_id = a02fd9b8-996c-48e0-92d2-f25962f7f1be response_code = 200 uri = /vpc-routes
18842024-11-28T01:55:40.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38707
18852024-11-28T01:55:40.758ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18862024-11-28T01:55:40.804ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18872024-11-28T01:55:40.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110975 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38707 req_id = d42fd6b2-5cd2-4ad1-a9f4-eac3f6182d74 response_code = 204 uri = /switch-ports
18882024-11-28T01:55:40.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63927
18892024-11-28T01:55:40.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64931
18902024-11-28T01:55:40.870ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
18912024-11-28T01:55:40.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38707 req_id = 6543716c-71af-4433-95f1-8e8174790293 response_code = 200 uri = /network-bootstore-config
18922024-11-28T01:55:40.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62560 req_id = 857406bc-bd0f-444d-86dd-6e19f1c5a339 response_code = 204 uri = /eip-gateways
18932024-11-28T01:55:40.870ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18942024-11-28T01:55:40.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64931 req_id = fba9f22b-d7c5-447f-9224-6da2522ff51f response_code = 200 uri = /v2p
18952024-11-28T01:55:40.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62560 req_id = 6dcf5421-4e30-4da9-af70-d84deb7c3d08 response_code = 204 uri = /vpc-routes
18962024-11-28T01:55:40.912ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18972024-11-28T01:55:40.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56619
18982024-11-28T01:55:40.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56619 req_id = 8cd18ac1-48f4-4c4e-9432-eb8f733e253a response_code = 200 uri = /vpc-routes
18992024-11-28T01:55:40.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34635
19002024-11-28T01:55:40.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34635 req_id = 5c0bd4e9-04bd-4f86-acc0-1b549ce0872d response_code = 200 uri = /v2p
19012024-11-28T01:55:40.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
19022024-11-28T01:55:40.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 697 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44280 req_id = 5b7281ad-db88-415a-bb3d-2f149c3ad743 response_code = 204 uri = /eip-gateways
19032024-11-28T01:55:40.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 984 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44280 req_id = 5407d10f-01c9-475e-8774-4ca1e35dc75f response_code = 204 uri = /vpc-routes
19042024-11-28T01:55:40.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63927 req_id = d26f2806-3095-4fe8-a075-33425d5591ef response_code = 204 uri = /switch-ports
19052024-11-28T01:55:40.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63927 req_id = 7311ca15-ed11-4ee3-a388-8d7dbd890f91 response_code = 200 uri = /network-bootstore-config
19062024-11-28T01:55:41.058ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
19072024-11-28T01:55:41.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56619 req_id = aa62fb05-5a09-4daf-968d-46d685a8735e response_code = 204 uri = /eip-gateways
19082024-11-28T01:55:41.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56619 req_id = 6a1c0d6d-b90e-47fb-bae8-46d68e170f61 response_code = 204 uri = /vpc-routes
19092024-11-28T01:55:41.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64059
19102024-11-28T01:55:41.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64059 req_id = f91e86bb-98f8-4418-8d3c-683838ee17fe response_code = 200 uri = /v2p
19112024-11-28T01:55:41.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47018
19122024-11-28T01:55:41.137ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19132024-11-28T01:55:41.177ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19142024-11-28T01:55:41.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96951 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47018 req_id = 7363b654-4482-4f5d-acdd-66853e126719 response_code = 204 uri = /switch-ports
19152024-11-28T01:55:41.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47018 req_id = 7947e21c-9aa6-473c-bae6-b7051f692903 response_code = 200 uri = /network-bootstore-config
19162024-11-28T01:55:54.205ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11045 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = ee689d70-3ada-42ff-af63-2437452c1976 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
19172024-11-28T01:55:56.363ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51369
19182024-11-28T01:55:56.363ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51369 req_id = 496c9b91-4528-4965-8be0-242564dc74d8 response_code = 200 uri = /baseboard
19192024-11-28T01:56:09.131ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19202024-11-28T01:56:10.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38533
19212024-11-28T01:56:10.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38533 req_id = b1920818-2238-4d2f-8f17-3ee54024e442 response_code = 200 uri = /vpc-routes
19222024-11-28T01:56:10.834ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
19232024-11-28T01:56:10.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38533 req_id = fe7be071-7bee-4f4a-81e8-e0ba80504e98 response_code = 204 uri = /eip-gateways
19242024-11-28T01:56:10.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38533 req_id = 0cabdd16-aa01-497d-8ac6-3d91c821d1a4 response_code = 204 uri = /vpc-routes
19252024-11-28T01:56:10.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48168
19262024-11-28T01:56:10.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48168 req_id = 0bd900c1-b52e-45ca-866b-1b9f79733cf9 response_code = 200 uri = /vpc-routes
19272024-11-28T01:56:11.004ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
19282024-11-28T01:56:11.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48168 req_id = b6f54984-84e5-42c7-af05-ea696bf10dad response_code = 204 uri = /eip-gateways
19292024-11-28T01:56:11.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56689
19302024-11-28T01:56:11.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56689 req_id = faad58ba-55da-4e55-9409-d6aca3855941 response_code = 200 uri = /v2p
19312024-11-28T01:56:11.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48168 req_id = 1527c41f-417b-43b3-aed4-41f33b75a74e response_code = 204 uri = /vpc-routes
19322024-11-28T01:56:11.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53914
19332024-11-28T01:56:11.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53914 req_id = 91bfcca2-446c-4050-a084-0bb5270f7f87 response_code = 200 uri = /vpc-routes
19342024-11-28T01:56:11.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52843
19352024-11-28T01:56:11.086ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19362024-11-28T01:56:11.136ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19372024-11-28T01:56:11.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52843 req_id = 06beb5b1-2ea1-4c35-a79b-0165b9ee6a17 response_code = 204 uri = /switch-ports
19382024-11-28T01:56:11.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39430
19392024-11-28T01:56:11.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59534
19402024-11-28T01:56:11.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52843 req_id = 869f1666-ff8c-426b-ac0e-7e15d22fc88c response_code = 200 uri = /network-bootstore-config
19412024-11-28T01:56:11.207ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19422024-11-28T01:56:11.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4888 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39430 req_id = 020866db-bd56-4391-8ad8-bd74cb7487bb response_code = 200 uri = /v2p
19432024-11-28T01:56:11.216ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
19442024-11-28T01:56:11.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53914 req_id = d611c75b-b776-44e2-8a60-de18ef6c345d response_code = 204 uri = /eip-gateways
19452024-11-28T01:56:11.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53914 req_id = 23aef886-c6d7-4eb5-b539-bd95cd8e21ba response_code = 204 uri = /vpc-routes
19462024-11-28T01:56:11.248ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19472024-11-28T01:56:11.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64916
19482024-11-28T01:56:11.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64916 req_id = 56de8999-6695-4c5d-860d-8e55a3cee137 response_code = 200 uri = /v2p
19492024-11-28T01:56:11.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101553 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59534 req_id = d61e6dc2-82c8-401a-87da-484a80ea9c76 response_code = 204 uri = /switch-ports
19502024-11-28T01:56:11.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59534 req_id = 6eb5b2a3-a450-4973-a13b-4df9ed9bf95d response_code = 200 uri = /network-bootstore-config
19512024-11-28T01:56:11.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49780
19522024-11-28T01:56:11.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19532024-11-28T01:56:11.366ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19542024-11-28T01:56:11.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94394 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49780 req_id = b638afb7-b18a-4a7d-98db-91c6b0d10c3f response_code = 204 uri = /switch-ports
19552024-11-28T01:56:11.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49780 req_id = 8fb6ac09-ee16-4b6f-bce5-31a2ba4423e7 response_code = 200 uri = /network-bootstore-config
19562024-11-28T01:56:24.202ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8046 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 39a06855-e436-4b67-ac54-0b9c34253a65 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
19572024-11-28T01:56:26.401ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35461
19582024-11-28T01:56:26.401ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35461 req_id = 6e8bad30-985e-46b8-a7d2-f4faf1022c21 response_code = 200 uri = /baseboard
19592024-11-28T01:56:40.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61871
19602024-11-28T01:56:40.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61871 req_id = 77ad10c6-007a-4a59-a9b5-1cac05779502 response_code = 200 uri = /vpc-routes
19612024-11-28T01:56:40.653ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
19622024-11-28T01:56:40.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61871 req_id = 6b17203f-db18-47ae-b47c-b8b01ff6c112 response_code = 204 uri = /eip-gateways
19632024-11-28T01:56:40.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57721
19642024-11-28T01:56:40.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57721 req_id = 51f955ed-d957-4958-9e0b-3c22ded3d4c5 response_code = 200 uri = /vpc-routes
19652024-11-28T01:56:40.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46340
19662024-11-28T01:56:40.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46340 req_id = 1eecc905-0d33-4e74-919a-2d8e784a0ac0 response_code = 200 uri = /v2p
19672024-11-28T01:56:40.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34242
19682024-11-28T01:56:40.741ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19692024-11-28T01:56:40.781ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19702024-11-28T01:56:40.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34242 req_id = 4602be4a-0a18-4956-9f4a-2a6d37c7f773 response_code = 204 uri = /switch-ports
19712024-11-28T01:56:40.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57200
19722024-11-28T01:56:40.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49066
19732024-11-28T01:56:40.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34242 req_id = 577a5783-1893-49a1-9893-17998f0c5c7c response_code = 200 uri = /network-bootstore-config
19742024-11-28T01:56:40.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57200 req_id = 878701ad-d9e0-4262-b24f-6126dbf4f781 response_code = 200 uri = /v2p
19752024-11-28T01:56:40.840ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19762024-11-28T01:56:40.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61871 req_id = 141fde57-1812-4567-9f5e-4e0a07575f4f response_code = 204 uri = /vpc-routes
19772024-11-28T01:56:40.877ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19782024-11-28T01:56:40.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45742
19792024-11-28T01:56:40.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45742 req_id = 368e7937-f74b-4a10-8147-b71667b4fd68 response_code = 200 uri = /vpc-routes
19802024-11-28T01:56:40.919ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
19812024-11-28T01:56:40.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57721 req_id = 7d1866fa-b25c-453f-ad3b-ddb5f814fe95 response_code = 204 uri = /eip-gateways
19822024-11-28T01:56:40.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49066 req_id = b3e8a5b5-81ac-499b-95d5-992681fe6f35 response_code = 204 uri = /switch-ports
19832024-11-28T01:56:40.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49066 req_id = 662d8b0a-8b41-4318-8ec8-6f8e0fb3a603 response_code = 200 uri = /network-bootstore-config
19842024-11-28T01:56:40.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
19852024-11-28T01:56:40.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45742 req_id = c4c693f0-a261-4369-9298-3766d6fea8c5 response_code = 204 uri = /eip-gateways
19862024-11-28T01:56:41.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57721 req_id = 14986e73-4def-41be-8786-a5700e53c671 response_code = 204 uri = /vpc-routes
19872024-11-28T01:56:41.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39378
19882024-11-28T01:56:41.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19892024-11-28T01:56:41.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19902024-11-28T01:56:41.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98391 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39378 req_id = 934c30b5-903f-4fb5-b9e8-af93fecaabdb response_code = 204 uri = /switch-ports
19912024-11-28T01:56:41.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38145
19922024-11-28T01:56:41.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39378 req_id = bb96b28f-fefe-44f7-b44c-43a3bba6492e response_code = 200 uri = /network-bootstore-config
19932024-11-28T01:56:41.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38145 req_id = 4f3c64c2-d094-4faf-9d68-6f1584deb1d9 response_code = 200 uri = /v2p
19942024-11-28T01:56:41.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 507 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45742 req_id = 5a05aced-61cf-40dc-b72d-b9b8d43a84d1 response_code = 204 uri = /vpc-routes
19952024-11-28T01:56:54.201ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6713 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = fb1e0251-4acb-41eb-9ef2-83c9466b3ad3 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
19962024-11-28T01:56:56.434ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55773
19972024-11-28T01:56:56.435ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55773 req_id = 8b94c205-da85-495f-9e36-acdb937a9219 response_code = 200 uri = /baseboard
19982024-11-28T01:57:10.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65272
19992024-11-28T01:57:10.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65272 req_id = 70d5b217-97b0-4d81-84b4-acf5c83e62f1 response_code = 200 uri = /vpc-routes
20002024-11-28T01:57:10.697ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
20012024-11-28T01:57:10.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65272 req_id = d1d13c02-c333-4ff2-bb1e-93bd7e0c85ad response_code = 204 uri = /eip-gateways
20022024-11-28T01:57:10.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65272 req_id = 1723a4c1-bf9e-46f4-971e-a9d031fd874c response_code = 204 uri = /vpc-routes
20032024-11-28T01:57:10.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32804
20042024-11-28T01:57:10.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32804 req_id = e78d101c-19c1-46f7-96e1-12b62982713a response_code = 200 uri = /vpc-routes
20052024-11-28T01:57:10.774ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
20062024-11-28T01:57:10.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32804 req_id = 6a9c76b5-8267-4df6-8212-c55e44d293f0 response_code = 204 uri = /eip-gateways
20072024-11-28T01:57:10.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32804 req_id = f6332495-4efd-44a1-86c1-e0c8aae1601b response_code = 204 uri = /vpc-routes
20082024-11-28T01:57:10.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36615
20092024-11-28T01:57:10.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36615 req_id = 49fdd7a5-95e4-4c86-860a-5f03b768c2ae response_code = 200 uri = /v2p
20102024-11-28T01:57:10.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56776
20112024-11-28T01:57:10.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56776 req_id = 06efc35f-9c90-41c4-89fd-7b32ffc90a5c response_code = 200 uri = /v2p
20122024-11-28T01:57:10.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44932
20132024-11-28T01:57:10.947ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20142024-11-28T01:57:10.986ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20152024-11-28T01:57:11.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94293 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44932 req_id = 18f404c8-d0cf-4a96-9fd8-5714a7073362 response_code = 204 uri = /switch-ports
20162024-11-28T01:57:11.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36151
20172024-11-28T01:57:11.042ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20182024-11-28T01:57:11.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4446 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44932 req_id = 36cd8c99-6418-4386-9755-2c2936e2c475 response_code = 200 uri = /network-bootstore-config
20192024-11-28T01:57:11.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52508
20202024-11-28T01:57:11.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52508 req_id = 91559496-9eb8-4c37-929e-179b5a613976 response_code = 200 uri = /v2p
20212024-11-28T01:57:11.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20222024-11-28T01:57:11.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59245
20232024-11-28T01:57:11.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59245 req_id = 79b31126-ea6a-4bb3-a3cd-d7fa3cd99b7d response_code = 200 uri = /vpc-routes
20242024-11-28T01:57:11.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95214 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36151 req_id = fd60d18c-aede-4e83-8a26-4553d5fc1423 response_code = 204 uri = /switch-ports
20252024-11-28T01:57:11.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36151 req_id = 4d086d42-1095-402f-99fe-cdf4f696e1ca response_code = 200 uri = /network-bootstore-config
20262024-11-28T01:57:11.166ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
20272024-11-28T01:57:11.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59245 req_id = 0f6334c9-df13-44e3-bddc-0b46699200c2 response_code = 204 uri = /eip-gateways
20282024-11-28T01:57:11.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59245 req_id = 6edad0e6-e778-4cc0-89c6-e52fd5f6eec5 response_code = 204 uri = /vpc-routes
20292024-11-28T01:57:11.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42302
20302024-11-28T01:57:11.185ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20312024-11-28T01:57:11.224ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20322024-11-28T01:57:11.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93775 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42302 req_id = 20d43820-22fc-4307-8aa0-fe86d2d593c3 response_code = 204 uri = /switch-ports
20332024-11-28T01:57:11.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42302 req_id = f92c80c5-37c5-4235-944a-73428cd95e28 response_code = 200 uri = /network-bootstore-config
20342024-11-28T01:57:24.202ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7884 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = ddddfdc1-d317-4f12-94fa-c0fc70b9c294 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
20352024-11-28T01:57:26.466ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36118
20362024-11-28T01:57:26.466ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36118 req_id = c6876a3c-37ec-4d38-a5e8-5d7101b9a3bf response_code = 200 uri = /baseboard
20372024-11-28T01:57:40.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44576
20382024-11-28T01:57:40.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44576 req_id = c1fc366b-0447-48cf-b4f5-d0e6cf4d665e response_code = 200 uri = /vpc-routes
20392024-11-28T01:57:40.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
20402024-11-28T01:57:40.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44576 req_id = 8c5a80c6-92d2-4cb3-916c-382dc7e3b37d response_code = 204 uri = /eip-gateways
20412024-11-28T01:57:40.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44576 req_id = 810e87d0-03a8-41d0-814e-1b4756ff1467 response_code = 204 uri = /vpc-routes
20422024-11-28T01:57:40.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58213
20432024-11-28T01:57:40.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58213 req_id = e367c496-2907-4c4f-9428-ee46b7d51d41 response_code = 200 uri = /vpc-routes
20442024-11-28T01:57:40.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61549
20452024-11-28T01:57:40.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61549 req_id = 9d5a513e-3cf3-4abc-8e18-8e4f8dcbf772 response_code = 200 uri = /v2p
20462024-11-28T01:57:40.769ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
20472024-11-28T01:57:40.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58213 req_id = cfc1aa44-c165-410c-8d64-cb525ec3f905 response_code = 204 uri = /eip-gateways
20482024-11-28T01:57:40.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58213 req_id = 1b41484c-69fe-44a0-a524-5fb78db98707 response_code = 204 uri = /vpc-routes
20492024-11-28T01:57:40.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39299
20502024-11-28T01:57:40.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39299 req_id = 450b949c-76ea-4fed-8f2c-bea703b94f45 response_code = 200 uri = /v2p
20512024-11-28T01:57:40.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59489
20522024-11-28T01:57:40.803ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20532024-11-28T01:57:40.839ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20542024-11-28T01:57:40.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90607 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59489 req_id = 680a97f2-ca4f-49b0-a3ac-0a2d5bd92ebc response_code = 204 uri = /switch-ports
20552024-11-28T01:57:40.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59324
20562024-11-28T01:57:40.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47098
20572024-11-28T01:57:40.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47098 req_id = 3fa7bb9a-8307-4eb3-bfbe-86dd74d18ed4 response_code = 200 uri = /vpc-routes
20582024-11-28T01:57:40.894ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20592024-11-28T01:57:40.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59489 req_id = 8a9f2622-2065-49c8-91c3-2941d5138501 response_code = 200 uri = /network-bootstore-config
20602024-11-28T01:57:40.929ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20612024-11-28T01:57:40.943ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
20622024-11-28T01:57:40.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47098 req_id = 98886870-f712-434a-ab04-7a4a806c7c95 response_code = 204 uri = /eip-gateways
20632024-11-28T01:57:40.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 719 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47098 req_id = 85be712b-b177-4a4a-bc5c-7d6c9c835b48 response_code = 204 uri = /vpc-routes
20642024-11-28T01:57:40.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41660
20652024-11-28T01:57:40.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41660 req_id = b8bcb2e1-53bd-43b6-aa94-9b6ff92d3b62 response_code = 200 uri = /v2p
20662024-11-28T01:57:40.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90056 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59324 req_id = a1f1a544-a878-46c4-99ca-53a5204d29f8 response_code = 204 uri = /switch-ports
20672024-11-28T01:57:40.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59324 req_id = 71a95e24-c4de-4fb3-8184-b4645453d4a0 response_code = 200 uri = /network-bootstore-config
20682024-11-28T01:57:41.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57314
20692024-11-28T01:57:41.058ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20702024-11-28T01:57:41.101ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20712024-11-28T01:57:41.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102756 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57314 req_id = c8f9f4c9-7ec0-4654-8dae-d909bf835a80 response_code = 204 uri = /switch-ports
20722024-11-28T01:57:41.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57314 req_id = 188049c8-03f1-45c8-aef7-41d7776dc95d response_code = 200 uri = /network-bootstore-config
20732024-11-28T01:57:54.202ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7751 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = d0caad61-8a3d-493c-89d5-7c65d5e0049a response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
20742024-11-28T01:57:56.524ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50021
20752024-11-28T01:57:56.524ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50021 req_id = 35ab4f1c-65c0-4f6a-802d-b1099feaf32a response_code = 200 uri = /baseboard
20762024-11-28T01:58:10.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42699
20772024-11-28T01:58:10.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42699 req_id = 7ea0871f-c063-4506-9925-cc60b3bd13ed response_code = 200 uri = /vpc-routes
20782024-11-28T01:58:10.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34438
20792024-11-28T01:58:10.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34438 req_id = 719f66df-c4f9-4001-89c0-8a11fe353bf1 response_code = 200 uri = /v2p
20802024-11-28T01:58:10.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
20812024-11-28T01:58:10.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42699 req_id = bc260757-2b03-4600-b091-e851d251d8b3 response_code = 204 uri = /eip-gateways
20822024-11-28T01:58:10.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59674
20832024-11-28T01:58:10.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59674 req_id = b8f38054-d29e-4544-9873-2b082598154b response_code = 200 uri = /v2p
20842024-11-28T01:58:10.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42699 req_id = bcaad87e-d2f5-4b7d-ae30-577a333058c4 response_code = 204 uri = /vpc-routes
20852024-11-28T01:58:11.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56061
20862024-11-28T01:58:11.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56061 req_id = 6d5b2094-ca70-4072-9759-e51a6edccb13 response_code = 200 uri = /v2p
20872024-11-28T01:58:11.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47473
20882024-11-28T01:58:11.087ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20892024-11-28T01:58:11.127ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20902024-11-28T01:58:11.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97773 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47473 req_id = 97497474-6f52-4a5c-b127-7adce8475a4e response_code = 204 uri = /switch-ports
20912024-11-28T01:58:11.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55692
20922024-11-28T01:58:11.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34840
20932024-11-28T01:58:11.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37250
20942024-11-28T01:58:11.185ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20952024-11-28T01:58:11.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3565 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34840 req_id = f9aff08c-2b73-4487-9dfa-07918af031e8 response_code = 200 uri = /vpc-routes
20962024-11-28T01:58:11.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3696 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47473 req_id = 035b6b02-2d78-4e3b-9029-069bdf91a1b5 response_code = 200 uri = /network-bootstore-config
20972024-11-28T01:58:11.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3710 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55692 req_id = 776bf4f0-146c-4076-847a-6a1e994cf998 response_code = 200 uri = /vpc-routes
20982024-11-28T01:58:11.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46100
20992024-11-28T01:58:11.227ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21002024-11-28T01:58:11.233ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
21012024-11-28T01:58:11.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34840 req_id = 6d48700c-716b-42f4-b4b4-ebeafb38c026 response_code = 204 uri = /eip-gateways
21022024-11-28T01:58:11.237ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
21032024-11-28T01:58:11.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55692 req_id = f20c9ccd-9076-48ae-90af-7f2942ea11ca response_code = 204 uri = /eip-gateways
21042024-11-28T01:58:11.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1097 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34840 req_id = 019f8705-f63f-4177-ab13-a6709e2aa4c5 response_code = 204 uri = /vpc-routes
21052024-11-28T01:58:11.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55692 req_id = ff8771b3-9c33-44f3-8221-ce88096029d4 response_code = 204 uri = /vpc-routes
21062024-11-28T01:58:11.288ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21072024-11-28T01:58:11.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103187 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37250 req_id = 53e14579-1e8c-4659-813b-1743b2b2a28a response_code = 204 uri = /switch-ports
21082024-11-28T01:58:11.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 690 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37250 req_id = e54ddf71-a190-4295-af89-58b1b4cf9df5 response_code = 200 uri = /network-bootstore-config
21092024-11-28T01:58:11.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57319
21102024-11-28T01:58:11.297ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21112024-11-28T01:58:11.297ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21122024-11-28T01:58:11.297ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21132024-11-28T01:58:11.297ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21142024-11-28T01:58:11.297ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21152024-11-28T01:58:11.297ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21162024-11-28T01:58:11.297ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21172024-11-28T01:58:11.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57319 req_id = 418bf54f-a2f8-4397-913c-3e7fb368b677 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21182024-11-28T01:58:11.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44981
21192024-11-28T01:58:11.308ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21202024-11-28T01:58:11.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21212024-11-28T01:58:11.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21222024-11-28T01:58:11.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21232024-11-28T01:58:11.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21242024-11-28T01:58:11.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21252024-11-28T01:58:11.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21262024-11-28T01:58:11.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44981 req_id = f3f796b7-e1c5-4b21-8cd4-d3ef55de1edf response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21272024-11-28T01:58:11.325ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21282024-11-28T01:58:11.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172320 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46100 req_id = 9ee16c04-b882-45e0-8f8a-0883d0a6878e response_code = 204 uri = /switch-ports
21292024-11-28T01:58:11.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46100 req_id = 9b233503-6a24-4277-8e78-d75898aa191a response_code = 200 uri = /network-bootstore-config
21302024-11-28T01:58:11.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65111
21312024-11-28T01:58:11.532ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21322024-11-28T01:58:11.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21332024-11-28T01:58:11.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21342024-11-28T01:58:11.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21352024-11-28T01:58:11.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21362024-11-28T01:58:11.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21372024-11-28T01:58:11.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21382024-11-28T01:58:11.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65111 req_id = 1093a04a-47e0-480a-90ad-85da0d3f41c0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21392024-11-28T01:58:24.203ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8215 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = bdc4f13d-cf0c-41e6-b980-d3d1c102ffcb response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
21402024-11-28T01:58:26.562ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33258
21412024-11-28T01:58:26.562ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33258 req_id = 3c4d6450-dd32-46f5-ada7-e268806c4ec6 response_code = 200 uri = /baseboard
21422024-11-28T01:58:40.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41478
21432024-11-28T01:58:40.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41478 req_id = b484e74a-e879-4f50-bb9e-dddb35b1f43e response_code = 200 uri = /vpc-routes
21442024-11-28T01:58:40.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39533
21452024-11-28T01:58:40.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39533 req_id = 48cecf8d-4990-4658-b716-378294e002ad response_code = 200 uri = /v2p
21462024-11-28T01:58:40.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59278
21472024-11-28T01:58:40.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59278 req_id = 62dd3f75-bc29-4c29-bd50-8d9750821f28 response_code = 200 uri = /vpc-routes
21482024-11-28T01:58:40.744ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
21492024-11-28T01:58:40.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41478 req_id = 024c94d7-9734-4fe1-b2b7-60d18e4a4c5b response_code = 204 uri = /eip-gateways
21502024-11-28T01:58:40.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41478 req_id = e4843035-6e55-4f9b-a319-be2cc9c81c8f response_code = 204 uri = /vpc-routes
21512024-11-28T01:58:40.778ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
21522024-11-28T01:58:40.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59278 req_id = 03458709-2315-4590-8e83-f4864baf4dee response_code = 204 uri = /eip-gateways
21532024-11-28T01:58:40.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51521
21542024-11-28T01:58:40.786ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21552024-11-28T01:58:40.826ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21562024-11-28T01:58:40.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97394 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51521 req_id = 8d6f8fc3-8640-4442-9041-f64965526c59 response_code = 204 uri = /switch-ports
21572024-11-28T01:58:40.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59972
21582024-11-28T01:58:40.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39976
21592024-11-28T01:58:40.884ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21602024-11-28T01:58:40.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51521 req_id = 2361aba4-dd1e-4855-9249-bf9adfabcf46 response_code = 200 uri = /network-bootstore-config
21612024-11-28T01:58:40.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3751 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39976 req_id = aff1ba3a-d065-4724-8f5d-405f50261b24 response_code = 200 uri = /v2p
21622024-11-28T01:58:40.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4003 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59278 req_id = 97d530e1-8676-4cf6-9aaa-2b17359dd5dd response_code = 204 uri = /vpc-routes
21632024-11-28T01:58:40.918ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21642024-11-28T01:58:40.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49448
21652024-11-28T01:58:40.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49448 req_id = 32c3ca4a-1865-47cc-9ae2-e888eb2debd9 response_code = 200 uri = /vpc-routes
21662024-11-28T01:58:40.938ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
21672024-11-28T01:58:40.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49448 req_id = 96f4e77e-d446-462c-8923-a109e5272f93 response_code = 204 uri = /eip-gateways
21682024-11-28T01:58:40.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46585
21692024-11-28T01:58:40.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46585 req_id = 5bbf08c2-57e6-418c-a4a8-10e875ee4ddc response_code = 200 uri = /v2p
21702024-11-28T01:58:40.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49448 req_id = 5e153c44-e5a5-4b7e-8378-19d4da0f3735 response_code = 204 uri = /vpc-routes
21712024-11-28T01:58:40.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59972 req_id = 27f36533-b857-4d16-8823-016d139aa7c6 response_code = 204 uri = /switch-ports
21722024-11-28T01:58:40.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59972 req_id = 5ef6a9d2-6117-4289-b861-eeb7b5bfe516 response_code = 200 uri = /network-bootstore-config
21732024-11-28T01:58:41.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43170
21742024-11-28T01:58:41.021ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21752024-11-28T01:58:41.055ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21762024-11-28T01:58:41.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90594 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43170 req_id = ffabba97-193d-4da4-bf55-e6f7572a392e response_code = 204 uri = /switch-ports
21772024-11-28T01:58:41.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43170 req_id = 79e4064c-cea9-43a6-9cb0-1c7830ec4b38 response_code = 200 uri = /network-bootstore-config
21782024-11-28T01:58:54.202ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7336 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 95eb7afd-7472-4852-bf22-3b13609ede34 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
21792024-11-28T01:58:56.594ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40021
21802024-11-28T01:58:56.595ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40021 req_id = 73fb1d8d-ab37-4d19-876d-4a953ebf1a57 response_code = 200 uri = /baseboard
21812024-11-28T01:59:10.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52443
21822024-11-28T01:59:10.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52443 req_id = 8c55c6e1-ae9a-4556-bb2c-93c351ead662 response_code = 200 uri = /vpc-routes
21832024-11-28T01:59:10.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60072
21842024-11-28T01:59:10.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60072 req_id = ed91b9b8-47a7-4dea-8f36-56b940e1cd45 response_code = 200 uri = /v2p
21852024-11-28T01:59:10.879ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
21862024-11-28T01:59:10.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52443 req_id = bb1d0819-b748-4041-8502-8e7adec7c6c7 response_code = 204 uri = /eip-gateways
21872024-11-28T01:59:10.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52443 req_id = 7551a0a7-6ff1-4dd7-949f-7ab988d0dd08 response_code = 204 uri = /vpc-routes
21882024-11-28T01:59:10.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40957
21892024-11-28T01:59:10.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40957 req_id = e9747419-9b83-479b-972d-d1c4af0bdada response_code = 200 uri = /v2p
21902024-11-28T01:59:11.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52139
21912024-11-28T01:59:11.005ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21922024-11-28T01:59:11.043ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21932024-11-28T01:59:11.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52139 req_id = a4bc0c26-6540-462f-bad7-bd627eafb7fd response_code = 204 uri = /switch-ports
21942024-11-28T01:59:11.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64192
21952024-11-28T01:59:11.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51824
21962024-11-28T01:59:11.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52139 req_id = 0460aa67-18ec-42d9-b850-48c2b3a330c7 response_code = 200 uri = /network-bootstore-config
21972024-11-28T01:59:11.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64192 req_id = 47cf39ec-71a9-4b4f-abda-cd710885aeb5 response_code = 200 uri = /vpc-routes
21982024-11-28T01:59:11.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51824 req_id = 36d88905-8be5-4848-a2f9-d24e87bf99dc response_code = 200 uri = /vpc-routes
21992024-11-28T01:59:11.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
22002024-11-28T01:59:11.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51824 req_id = c196c41b-f2c7-418f-b274-3b8d5044b92f response_code = 204 uri = /eip-gateways
22012024-11-28T01:59:11.144ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
22022024-11-28T01:59:11.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64192 req_id = 3bc02368-d129-4684-b38a-d788ebe1f0e9 response_code = 204 uri = /eip-gateways
22032024-11-28T01:59:11.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36271
22042024-11-28T01:59:11.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36271 req_id = db9aff49-7f73-4040-b741-a2cb1845df18 response_code = 200 uri = /v2p
22052024-11-28T01:59:11.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64192 req_id = 1f3e4138-30ad-4b72-a79c-d7b240ccb0f5 response_code = 204 uri = /vpc-routes
22062024-11-28T01:59:11.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51824 req_id = 5824dade-b999-4b0b-9c57-601afe905eaf response_code = 204 uri = /vpc-routes
22072024-11-28T01:59:11.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34108
22082024-11-28T01:59:11.202ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22092024-11-28T01:59:11.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22102024-11-28T01:59:11.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75265 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34108 req_id = e7d6cdc2-d7ab-4174-bc20-960a95a65df1 response_code = 204 uri = /switch-ports
22112024-11-28T01:59:11.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34108 req_id = 192f83d5-9ba5-48be-8159-1bb1bde32a8e response_code = 200 uri = /network-bootstore-config
22122024-11-28T01:59:11.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59370
22132024-11-28T01:59:11.285ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22142024-11-28T01:59:11.326ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22152024-11-28T01:59:11.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95324 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59370 req_id = 0d790879-9e3a-44fb-a27a-37dc2a407d0f response_code = 204 uri = /switch-ports
22162024-11-28T01:59:11.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59370 req_id = 262e5eb7-197c-4a25-a8eb-b9eb5f6248df response_code = 200 uri = /network-bootstore-config
22172024-11-28T01:59:24.203ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7781 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = f57bca82-c5fb-46e8-ade2-368d3380ab22 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
22182024-11-28T01:59:26.629ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50058
22192024-11-28T01:59:26.629ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50058 req_id = 9d1c8de8-f220-46bc-b736-6782cd84042b response_code = 200 uri = /baseboard
22202024-11-28T01:59:40.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45103
22212024-11-28T01:59:40.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45103 req_id = 882ec258-5d0d-42cf-9178-1733c9c98def response_code = 200 uri = /vpc-routes
22222024-11-28T01:59:40.650ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
22232024-11-28T01:59:40.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45103 req_id = 1687b7ab-66c8-4288-bdea-d1fa6c4c4d25 response_code = 204 uri = /eip-gateways
22242024-11-28T01:59:40.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45103 req_id = 65e476d1-c2d2-495a-934c-72ecd3e41e4c response_code = 204 uri = /vpc-routes
22252024-11-28T01:59:40.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62808
22262024-11-28T01:59:40.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62808 req_id = 0815371d-90a0-40d3-929b-62778f76754a response_code = 200 uri = /vpc-routes
22272024-11-28T01:59:40.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60491
22282024-11-28T01:59:40.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60491 req_id = 97323df5-6859-4280-8029-5ae47550e732 response_code = 200 uri = /v2p
22292024-11-28T01:59:40.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37947
22302024-11-28T01:59:40.743ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22312024-11-28T01:59:40.784ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22322024-11-28T01:59:40.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37947 req_id = 4eacb7d6-09c2-4f36-96cc-39a54de39b41 response_code = 204 uri = /switch-ports
22332024-11-28T01:59:40.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47946
22342024-11-28T01:59:40.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55117
22352024-11-28T01:59:40.844ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
22362024-11-28T01:59:40.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62808 req_id = 3051f885-78a8-4d2f-a5dc-e396c2834a75 response_code = 204 uri = /eip-gateways
22372024-11-28T01:59:40.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37947 req_id = d90aecb9-6fb2-4edc-9769-2800f07fa1e1 response_code = 200 uri = /network-bootstore-config
22382024-11-28T01:59:40.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22392024-11-28T01:59:40.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55117 req_id = b634265f-7f14-448f-ad36-8ab7d53cce59 response_code = 200 uri = /v2p
22402024-11-28T01:59:40.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62808 req_id = f27d1326-3806-4100-9c29-1b17453acdb5 response_code = 204 uri = /vpc-routes
22412024-11-28T01:59:40.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22422024-11-28T01:59:40.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95815 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47946 req_id = 2e555227-bdcb-418a-8bc2-fadb87abc75f response_code = 204 uri = /switch-ports
22432024-11-28T01:59:40.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47946 req_id = 2b45bd86-9108-4192-ad4c-af35f74c4115 response_code = 200 uri = /network-bootstore-config
22442024-11-28T01:59:40.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37849
22452024-11-28T01:59:40.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37849 req_id = 8ef665d9-8942-4047-91e6-bed433032786 response_code = 200 uri = /vpc-routes
22462024-11-28T01:59:40.999ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
22472024-11-28T01:59:40.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37849 req_id = 311e5fff-3f03-46b8-a0b2-576c17af3297 response_code = 204 uri = /eip-gateways
22482024-11-28T01:59:41.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37849 req_id = 3eb714cb-8271-434d-9a18-7771555e0ce8 response_code = 204 uri = /vpc-routes
22492024-11-28T01:59:41.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59606
22502024-11-28T01:59:41.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59606 req_id = d1d8a365-dd72-40fa-bb67-228a935ae833 response_code = 200 uri = /v2p
22512024-11-28T01:59:41.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62748
22522024-11-28T01:59:41.052ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22532024-11-28T01:59:41.088ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22542024-11-28T01:59:41.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92770 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62748 req_id = 701fd92d-2a55-45d8-9569-7a99412a3987 response_code = 204 uri = /switch-ports
22552024-11-28T01:59:41.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62748 req_id = 0a09b08f-45ed-4e19-8a00-31a0f39788b9 response_code = 200 uri = /network-bootstore-config
22562024-11-28T01:59:54.202ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7746 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = f49037e3-5857-4a24-a313-6f48001c8426 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
22572024-11-28T01:59:56.664ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54433
22582024-11-28T01:59:56.664ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54433 req_id = fe9f204d-7d1c-4939-8713-578cb3ca4c8b response_code = 200 uri = /baseboard
22592024-11-28T02:00:10.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46046
22602024-11-28T02:00:10.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46046 req_id = 3d21205b-a226-405c-bd75-138ecd81de6e response_code = 200 uri = /vpc-routes
22612024-11-28T02:00:10.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46036
22622024-11-28T02:00:10.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46036 req_id = 8b579740-12a0-4f08-91b3-2a1b5eca41cd response_code = 200 uri = /v2p
22632024-11-28T02:00:10.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53969
22642024-11-28T02:00:10.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53969 req_id = 7313d1f5-f65b-41d3-92ac-55b4565df698 response_code = 200 uri = /vpc-routes
22652024-11-28T02:00:10.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40165
22662024-11-28T02:00:10.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40165 req_id = f28e6a03-840c-4e81-976f-3816913a7cb8 response_code = 200 uri = /vpc-routes
22672024-11-28T02:00:10.999ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
22682024-11-28T02:00:10.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46046 req_id = b55fa6bf-306e-406a-b7b5-7014359e4708 response_code = 204 uri = /eip-gateways
22692024-11-28T02:00:11.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46046 req_id = f2e34964-3e84-4880-91cf-ddcf8c4ee9bb response_code = 204 uri = /vpc-routes
22702024-11-28T02:00:11.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
22712024-11-28T02:00:11.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40165 req_id = eb04e11f-71d1-4497-81c1-955fc34e0890 response_code = 204 uri = /eip-gateways
22722024-11-28T02:00:11.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
22732024-11-28T02:00:11.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53969 req_id = f5282ddc-ce31-4290-884b-7cddef30846b response_code = 204 uri = /eip-gateways
22742024-11-28T02:00:11.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60002
22752024-11-28T02:00:11.036ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22762024-11-28T02:00:11.087ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22772024-11-28T02:00:11.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132435 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60002 req_id = 34ef9ceb-f7b7-46b9-92e6-9bb8e1599ad8 response_code = 204 uri = /switch-ports
22782024-11-28T02:00:11.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65076
22792024-11-28T02:00:11.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41776
22802024-11-28T02:00:11.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50904
22812024-11-28T02:00:11.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60002 req_id = ed5449ca-d835-4b3e-bdca-b30fec891723 response_code = 200 uri = /network-bootstore-config
22822024-11-28T02:00:11.169ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22832024-11-28T02:00:11.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5919 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65076 req_id = d1f017f9-a70a-4458-9bb1-adb881201e77 response_code = 200 uri = /v2p
22842024-11-28T02:00:11.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40165 req_id = 095872ab-0c4c-4899-9c8e-807f87f95dc0 response_code = 204 uri = /vpc-routes
22852024-11-28T02:00:11.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53969 req_id = a85cb884-1544-4861-95fe-a80a53b8df50 response_code = 204 uri = /vpc-routes
22862024-11-28T02:00:11.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44808
22872024-11-28T02:00:11.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44808 req_id = fd84744d-78b3-407a-a8a6-70eb51b46696 response_code = 200 uri = /v2p
22882024-11-28T02:00:11.220ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22892024-11-28T02:00:11.281ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22902024-11-28T02:00:11.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50904 req_id = 4f6f8251-2dd8-40a1-b7c5-a75f78c0c2c0 response_code = 204 uri = /switch-ports
22912024-11-28T02:00:11.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 696 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50904 req_id = 0ee2da2e-6051-4546-b074-9c4b0f657131 response_code = 200 uri = /network-bootstore-config
22922024-11-28T02:00:11.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22932024-11-28T02:00:11.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189844 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41776 req_id = 18e5ecd9-e1ed-4daf-9d21-38c284aa4d74 response_code = 204 uri = /switch-ports
22942024-11-28T02:00:11.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41776 req_id = 1a6a1b91-6a79-4e7d-a86b-6ce735fb0e11 response_code = 200 uri = /network-bootstore-config
22952024-11-28T02:00:24.203ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8500 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 38839653-6f6a-4e9e-bdb3-809eea07b479 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
22962024-11-28T02:00:26.697ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40660
22972024-11-28T02:00:26.697ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40660 req_id = a29fb479-7a2a-4923-92ce-faac0f4c6b29 response_code = 200 uri = /baseboard
22982024-11-28T02:00:40.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64308
22992024-11-28T02:00:40.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64308 req_id = fa7d5e9e-f7e1-4b9c-9585-11c0a3d4e892 response_code = 200 uri = /vpc-routes
23002024-11-28T02:00:40.724ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
23012024-11-28T02:00:40.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64308 req_id = a0b92dfc-cbc1-4b38-9bf3-0409af4c5782 response_code = 204 uri = /eip-gateways
23022024-11-28T02:00:40.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64308 req_id = 908305c3-b777-4992-8d58-4a92d7e27a2e response_code = 204 uri = /vpc-routes
23032024-11-28T02:00:40.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64274
23042024-11-28T02:00:40.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64274 req_id = 2d28fce2-28f6-4ed2-b632-4fec8b83ffb0 response_code = 200 uri = /vpc-routes
23052024-11-28T02:00:40.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48825
23062024-11-28T02:00:40.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48825 req_id = accaebdb-1ea3-4c1c-8954-6793e5e74cd9 response_code = 200 uri = /v2p
23072024-11-28T02:00:40.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
23082024-11-28T02:00:40.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64274 req_id = d988876a-9b39-4c76-b367-a1f5562c3a3a response_code = 204 uri = /eip-gateways
23092024-11-28T02:00:40.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40092
23102024-11-28T02:00:40.861ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23112024-11-28T02:00:40.900ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23122024-11-28T02:00:40.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97433 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40092 req_id = f3e699e3-d726-47c3-9511-614626b860ac response_code = 204 uri = /switch-ports
23132024-11-28T02:00:40.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49879
23142024-11-28T02:00:40.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37031
23152024-11-28T02:00:40.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35980
23162024-11-28T02:00:40.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40092 req_id = e91bca49-fdc1-4552-b2b8-c7541d028353 response_code = 200 uri = /network-bootstore-config
23172024-11-28T02:00:40.959ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23182024-11-28T02:00:40.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5792 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37031 req_id = a5cad96b-d024-469b-a07f-b33d9ea37a94 response_code = 200 uri = /vpc-routes
23192024-11-28T02:00:40.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5785 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35980 req_id = fe4f0f8c-0ad1-4eef-9290-7b4726d4b319 response_code = 200 uri = /v2p
23202024-11-28T02:00:40.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6088 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64274 req_id = 83712e28-a4d5-4cd7-a30c-0f82f371450f response_code = 204 uri = /vpc-routes
23212024-11-28T02:00:40.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
23222024-11-28T02:00:40.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37031 req_id = 2d868bff-5fe9-4466-be35-73417eb9be7a response_code = 204 uri = /eip-gateways
23232024-11-28T02:00:40.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 951 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37031 req_id = c49f0361-d685-46de-927a-f1619fedb3c4 response_code = 204 uri = /vpc-routes
23242024-11-28T02:00:40.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58820
23252024-11-28T02:00:40.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58820 req_id = 582fb3e7-a018-46bb-8934-4c7d61bf74a9 response_code = 200 uri = /v2p
23262024-11-28T02:00:41.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23272024-11-28T02:00:41.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98600 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49879 req_id = 48a8e802-072d-4e79-b93c-68165e2d4282 response_code = 204 uri = /switch-ports
23282024-11-28T02:00:41.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49879 req_id = ad7989a5-e98d-4492-ab4a-8b6bd4e352c3 response_code = 200 uri = /network-bootstore-config
23292024-11-28T02:00:41.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58295
23302024-11-28T02:00:41.083ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23312024-11-28T02:00:41.121ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23322024-11-28T02:00:41.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94286 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58295 req_id = dc3fcb96-6ee7-47e2-bc5e-684edef76ad4 response_code = 204 uri = /switch-ports
23332024-11-28T02:00:41.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58295 req_id = 48d3c8f3-857a-4ad5-84ba-9b0a0272ea0f response_code = 200 uri = /network-bootstore-config
23342024-11-28T02:00:54.203ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7584 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = bc9fe8bb-4062-4b0a-a2e1-3a02344d445f response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
23352024-11-28T02:00:54.559ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23362024-11-28T02:00:54.560ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23372024-11-28T02:00:54.591ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1921, tv_nsec: 62393214 } time_to_next_cleanup = 599.99999575s
23382024-11-28T02:00:56.729ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63729
23392024-11-28T02:00:56.729ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63729 req_id = f9e1a26b-81ee-4ecc-aa7c-eb0f6370ef78 response_code = 200 uri = /baseboard
23402024-11-28T02:01:09.133ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23412024-11-28T02:01:10.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36686
23422024-11-28T02:01:10.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36686 req_id = 6adce24b-45ba-48dc-8f22-fb84daec4e8b response_code = 200 uri = /vpc-routes
23432024-11-28T02:01:10.765ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
23442024-11-28T02:01:10.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36686 req_id = b17b7a00-f39f-44d0-a3c7-98d866412da3 response_code = 204 uri = /eip-gateways
23452024-11-28T02:01:10.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36686 req_id = 510b7791-dfb3-43dd-a19d-837bce24e3bb response_code = 204 uri = /vpc-routes
23462024-11-28T02:01:10.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55276
23472024-11-28T02:01:10.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55276 req_id = a0d0baf4-5a21-4ede-b2eb-e290d488e497 response_code = 200 uri = /vpc-routes
23482024-11-28T02:01:10.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49676
23492024-11-28T02:01:10.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49676 req_id = 384144b0-688c-4e89-b121-9777dd20058d response_code = 200 uri = /vpc-routes
23502024-11-28T02:01:10.891ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
23512024-11-28T02:01:10.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55276 req_id = 52576a85-4512-4ce4-8cfb-f2832611e2cd response_code = 204 uri = /eip-gateways
23522024-11-28T02:01:10.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55276 req_id = 84aa8aad-f63d-4b6a-a465-4072c19761f5 response_code = 204 uri = /vpc-routes
23532024-11-28T02:01:10.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
23542024-11-28T02:01:10.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49676 req_id = 957298c7-880a-4fc2-b91c-90acf6ca72d3 response_code = 204 uri = /eip-gateways
23552024-11-28T02:01:10.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50719
23562024-11-28T02:01:10.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50719 req_id = 56b0c03f-1a21-46a2-8d89-cb61ef44781a response_code = 200 uri = /v2p
23572024-11-28T02:01:10.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39051
23582024-11-28T02:01:10.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39051 req_id = 20e8fbcf-8697-40be-8167-0f1415811190 response_code = 200 uri = /v2p
23592024-11-28T02:01:11.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48688
23602024-11-28T02:01:11.004ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23612024-11-28T02:01:11.042ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23622024-11-28T02:01:11.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97842 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48688 req_id = b7d20070-7cb3-4f67-bf23-0c049f3552f7 response_code = 204 uri = /switch-ports
23632024-11-28T02:01:11.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42337
23642024-11-28T02:01:11.102ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23652024-11-28T02:01:11.138ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23662024-11-28T02:01:11.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91233 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42337 req_id = ba6ac609-d32a-41b4-a50d-b13ee3a08664 response_code = 204 uri = /switch-ports
23672024-11-28T02:01:11.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48688 req_id = 6cc2ed0f-059e-4851-a07b-43baac8243e8 response_code = 200 uri = /network-bootstore-config
23682024-11-28T02:01:11.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42337 req_id = 9473d11c-7fde-4a24-8262-244b1d8d26c6 response_code = 200 uri = /network-bootstore-config
23692024-11-28T02:01:11.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46206
23702024-11-28T02:01:11.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46206 req_id = b612190b-75b6-488a-9dfe-0d094ef6f913 response_code = 200 uri = /v2p
23712024-11-28T02:01:11.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49676 req_id = 81e2ffd6-e595-4441-9924-0ce0e4098406 response_code = 204 uri = /vpc-routes
23722024-11-28T02:01:11.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41892
23732024-11-28T02:01:11.316ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23742024-11-28T02:01:11.352ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23752024-11-28T02:01:11.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89194 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41892 req_id = 5f6dd3a7-e5f1-4a3e-8516-82b1f8f7d651 response_code = 204 uri = /switch-ports
23762024-11-28T02:01:11.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41892 req_id = 227b99e2-5b23-4351-b33f-97098daf2c74 response_code = 200 uri = /network-bootstore-config
23772024-11-28T02:01:24.204ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8598 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 28c29846-72bd-4768-86ce-ba240d6935bc response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
23782024-11-28T02:01:26.761ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42279
23792024-11-28T02:01:26.761ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42279 req_id = a8280c42-2a7c-4d49-9bfd-a8668481b0e2 response_code = 200 uri = /baseboard
23802024-11-28T02:01:40.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40499
23812024-11-28T02:01:40.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40499 req_id = 021dce84-18bc-4df0-b35f-cbaeadec1d10 response_code = 200 uri = /vpc-routes
23822024-11-28T02:01:40.595ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
23832024-11-28T02:01:40.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40499 req_id = fc942710-89f9-405a-bedd-5d510e6af78c response_code = 204 uri = /eip-gateways
23842024-11-28T02:01:40.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40499 req_id = 75d3a9db-e7d0-4562-b817-c3602e32e9c0 response_code = 204 uri = /vpc-routes
23852024-11-28T02:01:40.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60655
23862024-11-28T02:01:40.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60655 req_id = 2e48a0ac-7d45-4fd4-86ec-d13af5ed4e24 response_code = 200 uri = /v2p
23872024-11-28T02:01:40.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53373
23882024-11-28T02:01:40.707ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23892024-11-28T02:01:40.760ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23902024-11-28T02:01:40.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117482 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53373 req_id = e9570c3b-e8f4-4d7d-8602-2e8318c748b6 response_code = 204 uri = /switch-ports
23912024-11-28T02:01:40.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43223
23922024-11-28T02:01:40.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42871
23932024-11-28T02:01:40.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46048
23942024-11-28T02:01:40.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53373 req_id = 729c8f86-e68d-4ea1-84d1-f114da352812 response_code = 200 uri = /network-bootstore-config
23952024-11-28T02:01:40.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43223 req_id = b5225b2a-9051-44e1-9a55-5474e35ec142 response_code = 200 uri = /vpc-routes
23962024-11-28T02:01:40.825ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23972024-11-28T02:01:40.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3824 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42871 req_id = f811da62-4d57-4d3e-9d4a-9161f4d1b8dd response_code = 200 uri = /v2p
23982024-11-28T02:01:40.844ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
23992024-11-28T02:01:40.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43223 req_id = 20689ed3-b6ec-43be-9561-36dad394fc2a response_code = 204 uri = /eip-gateways
24002024-11-28T02:01:40.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1008 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43223 req_id = 40b794bc-b9ef-4e4a-bc34-837987d2a764 response_code = 204 uri = /vpc-routes
24012024-11-28T02:01:40.861ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24022024-11-28T02:01:40.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58486
24032024-11-28T02:01:40.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58486 req_id = 6c94268f-823d-4dcb-8aa0-48774bd47648 response_code = 200 uri = /vpc-routes
24042024-11-28T02:01:40.892ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
24052024-11-28T02:01:40.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58486 req_id = e31d3dfa-688a-4044-b0d3-e154b30a03a2 response_code = 204 uri = /eip-gateways
24062024-11-28T02:01:40.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46048 req_id = 2791573f-e0cd-4379-9dc9-54091f162beb response_code = 204 uri = /switch-ports
24072024-11-28T02:01:40.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46048 req_id = 649a8827-d75d-42b4-84e9-e88480c36a1c response_code = 200 uri = /network-bootstore-config
24082024-11-28T02:01:40.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42926
24092024-11-28T02:01:40.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42926 req_id = 9fe1b7fb-3056-4c33-acba-d20913cfb7b5 response_code = 200 uri = /v2p
24102024-11-28T02:01:40.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58486 req_id = 7286f4fc-1698-44d5-85c3-5309663d3e91 response_code = 204 uri = /vpc-routes
24112024-11-28T02:01:41.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42224
24122024-11-28T02:01:41.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24132024-11-28T02:01:41.088ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24142024-11-28T02:01:41.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85409 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42224 req_id = ef41b9b7-6dff-4396-b566-bd30a5a0b239 response_code = 204 uri = /switch-ports
24152024-11-28T02:01:41.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42224 req_id = 4ffd6d9e-9f15-43b7-9de9-66ec372eb5bd response_code = 200 uri = /network-bootstore-config
24162024-11-28T02:01:54.203ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7934 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 4edfef44-8334-44aa-bb8e-1ba82520c0b8 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
24172024-11-28T02:01:56.795ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51502
24182024-11-28T02:01:56.795ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51502 req_id = 3cc2eb5c-bb9d-4319-b119-d82e07b152c1 response_code = 200 uri = /baseboard
24192024-11-28T02:02:10.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38099
24202024-11-28T02:02:10.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38099 req_id = e6764fdb-8405-4a5e-9764-e10f90aeb6ab response_code = 200 uri = /vpc-routes
24212024-11-28T02:02:10.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41091
24222024-11-28T02:02:10.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41091 req_id = c76f85c4-346f-4a4d-9356-4d4528302e04 response_code = 200 uri = /v2p
24232024-11-28T02:02:10.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
24242024-11-28T02:02:10.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38099 req_id = 22dfe7d8-e58f-4882-a820-d233c2b30607 response_code = 204 uri = /eip-gateways
24252024-11-28T02:02:10.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38099 req_id = 610fc24f-4052-4a25-ac5c-1fc33468ed24 response_code = 204 uri = /vpc-routes
24262024-11-28T02:02:10.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44869
24272024-11-28T02:02:10.929ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24282024-11-28T02:02:10.968ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24292024-11-28T02:02:11.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44869 req_id = c4eb43d7-ab3c-4ec6-bc8c-5d64fe3f2f14 response_code = 204 uri = /switch-ports
24302024-11-28T02:02:11.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41864
24312024-11-28T02:02:11.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55512
24322024-11-28T02:02:11.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44869 req_id = 0c109507-fa1a-4444-98f2-3357281474ee response_code = 200 uri = /network-bootstore-config
24332024-11-28T02:02:11.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41864 req_id = c7bd473c-927a-4256-9265-4cdef85047a7 response_code = 200 uri = /vpc-routes
24342024-11-28T02:02:11.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55512 req_id = a8045e13-a57c-4e93-892c-d76e53ce6446 response_code = 200 uri = /v2p
24352024-11-28T02:02:11.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53586
24362024-11-28T02:02:11.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53586 req_id = 625931cc-f5eb-4bd1-8553-4664c8938f29 response_code = 200 uri = /vpc-routes
24372024-11-28T02:02:11.085ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
24382024-11-28T02:02:11.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41864 req_id = 35b90757-0b62-4955-a4ae-3f5d76ff8bf5 response_code = 204 uri = /eip-gateways
24392024-11-28T02:02:11.092ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
24402024-11-28T02:02:11.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53586 req_id = c0df739a-0685-43c9-b15b-9522db484a8a response_code = 204 uri = /eip-gateways
24412024-11-28T02:02:11.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41864 req_id = 6979d578-7207-410d-9138-125e1f0b5bbc response_code = 204 uri = /vpc-routes
24422024-11-28T02:02:11.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53586 req_id = 6a2434f5-affa-47bd-8f20-27b4b1551e5b response_code = 204 uri = /vpc-routes
24432024-11-28T02:02:11.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44787
24442024-11-28T02:02:11.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44787 req_id = 0b342263-3fee-44c0-820e-48cffd0f4906 response_code = 200 uri = /v2p
24452024-11-28T02:02:11.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35155
24462024-11-28T02:02:11.140ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24472024-11-28T02:02:11.177ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24482024-11-28T02:02:11.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35155 req_id = ec35f2a1-3271-40e6-8787-b0c7f6bf0ee4 response_code = 204 uri = /switch-ports
24492024-11-28T02:02:11.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51204
24502024-11-28T02:02:11.233ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24512024-11-28T02:02:11.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35155 req_id = 3ca7211f-9fd4-4f32-8528-76f7759e2bff response_code = 200 uri = /network-bootstore-config
24522024-11-28T02:02:11.269ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24532024-11-28T02:02:11.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90143 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51204 req_id = 5c0b6371-2fd2-44fa-a6a1-0d9bed570fea response_code = 204 uri = /switch-ports
24542024-11-28T02:02:11.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51204 req_id = 5a90d474-7155-43c3-9a18-fcea33fe1f0e response_code = 200 uri = /network-bootstore-config
24552024-11-28T02:02:24.204ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8505 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 725b3c6b-a720-4195-964d-86877f3bbd59 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
24562024-11-28T02:02:26.828ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62233
24572024-11-28T02:02:26.828ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62233 req_id = 5912dbb8-ec4d-403a-a6d8-ed46492f511c response_code = 200 uri = /baseboard
24582024-11-28T02:02:40.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32888
24592024-11-28T02:02:40.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32888 req_id = 809894af-acc0-48a6-96cd-5a5e690916e4 response_code = 200 uri = /vpc-routes
24602024-11-28T02:02:40.621ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
24612024-11-28T02:02:40.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32888 req_id = 25a5ae33-7e77-402d-a85b-9ac0e2b94c32 response_code = 204 uri = /eip-gateways
24622024-11-28T02:02:40.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48962
24632024-11-28T02:02:40.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48962 req_id = 6d1f68c0-2aa7-46df-bcf0-67f8c2487f5a response_code = 200 uri = /v2p
24642024-11-28T02:02:40.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32888 req_id = 3467254a-4a53-4763-9207-ab9f29c059a7 response_code = 204 uri = /vpc-routes
24652024-11-28T02:02:40.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49220
24662024-11-28T02:02:40.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49220 req_id = bbc36826-a2af-425e-847a-83d5ba65e43b response_code = 200 uri = /vpc-routes
24672024-11-28T02:02:40.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
24682024-11-28T02:02:40.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49220 req_id = abb7c9a7-3a2d-41ba-baae-3d395d782d07 response_code = 204 uri = /eip-gateways
24692024-11-28T02:02:40.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64972
24702024-11-28T02:02:40.655ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24712024-11-28T02:02:40.702ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24722024-11-28T02:02:40.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64972 req_id = 62ce0a7c-e05a-4fd7-b162-190a43864942 response_code = 204 uri = /switch-ports
24732024-11-28T02:02:40.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64972 req_id = 3f7832b9-6121-4f09-bed4-eedcd0751781 response_code = 200 uri = /network-bootstore-config
24742024-11-28T02:02:40.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49220 req_id = 24e3607c-b4d0-458f-88e1-bd1dba0609df response_code = 204 uri = /vpc-routes
24752024-11-28T02:02:40.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63682
24762024-11-28T02:02:40.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63682 req_id = 42695025-fdf4-4b99-8ca9-e2486b686601 response_code = 200 uri = /v2p
24772024-11-28T02:02:40.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49993
24782024-11-28T02:02:40.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49993 req_id = acf2e582-6ca3-4d97-9007-5c2edeaeb5aa response_code = 200 uri = /vpc-routes
24792024-11-28T02:02:40.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55396
24802024-11-28T02:02:40.867ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24812024-11-28T02:02:40.902ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24822024-11-28T02:02:40.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90047 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55396 req_id = a169ea7e-c833-4ec8-96ab-5f4f8680f8d1 response_code = 204 uri = /switch-ports
24832024-11-28T02:02:40.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53794
24842024-11-28T02:02:40.957ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
24852024-11-28T02:02:40.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55396 req_id = 8377e7d8-0382-4570-a750-86234405d576 response_code = 200 uri = /network-bootstore-config
24862024-11-28T02:02:40.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49993 req_id = bcf42bf7-6e68-4385-9d40-d315dd35f258 response_code = 204 uri = /eip-gateways
24872024-11-28T02:02:40.957ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24882024-11-28T02:02:40.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49993 req_id = 7b220a52-4bf1-4049-8ceb-57076be34941 response_code = 204 uri = /vpc-routes
24892024-11-28T02:02:40.992ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24902024-11-28T02:02:41.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95101 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53794 req_id = c14eed77-0c08-420d-b294-5af17796c5b4 response_code = 204 uri = /switch-ports
24912024-11-28T02:02:41.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53794 req_id = 4f1ef0bd-e62a-4ef2-b45e-8bce453969b3 response_code = 200 uri = /network-bootstore-config
24922024-11-28T02:02:41.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56830
24932024-11-28T02:02:41.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56830 req_id = 6f266a0a-b137-4029-b3b0-50c241ef4a8a response_code = 200 uri = /v2p
24942024-11-28T02:02:54.204ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7985 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 16351a7e-cd4c-40c4-932f-65b56248837a response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
24952024-11-28T02:02:56.860ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50455
24962024-11-28T02:02:56.860ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50455 req_id = 0a8e973d-5500-46a9-9d71-e40d925f506b response_code = 200 uri = /baseboard
24972024-11-28T02:03:10.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57844
24982024-11-28T02:03:10.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57844 req_id = d5426e49-2057-4f5c-9f29-085420973f32 response_code = 200 uri = /vpc-routes
24992024-11-28T02:03:10.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38108
25002024-11-28T02:03:10.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38108 req_id = 3179432d-51b4-402a-9bcc-b9986c6a957c response_code = 200 uri = /v2p
25012024-11-28T02:03:10.909ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
25022024-11-28T02:03:10.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57844 req_id = 1bf565dd-5c15-4a3f-9456-f255fcb4f19d response_code = 204 uri = /eip-gateways
25032024-11-28T02:03:10.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57844 req_id = c324a67e-fbed-4957-9124-d41c48df2e1e response_code = 204 uri = /vpc-routes
25042024-11-28T02:03:10.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37872
25052024-11-28T02:03:10.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37872 req_id = 6454a76c-cb6c-43ef-8638-7c4369dafe56 response_code = 200 uri = /vpc-routes
25062024-11-28T02:03:11.015ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
25072024-11-28T02:03:11.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37872 req_id = 2d8bb181-bdb8-4dfc-bbf3-97ba5c540d4b response_code = 204 uri = /eip-gateways
25082024-11-28T02:03:11.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37872 req_id = 6f412c0b-dcf9-400f-8866-2ae020acc41c response_code = 204 uri = /vpc-routes
25092024-11-28T02:03:11.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52782
25102024-11-28T02:03:11.030ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25112024-11-28T02:03:11.030ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25122024-11-28T02:03:11.030ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:177
25132024-11-28T02:03:11.031ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:177
25142024-11-28T02:03:11.043ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25152024-11-28T02:03:11.043ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_89678a9e-6cf0-40f7-a395-8631085163d8
25162024-11-28T02:03:11.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43731
25172024-11-28T02:03:11.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25182024-11-28T02:03:11.073ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25192024-11-28T02:03:11.073ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69
25202024-11-28T02:03:11.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64411
25212024-11-28T02:03:11.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59834
25222024-11-28T02:03:11.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59834 req_id = 84894454-e029-416b-862c-b433cc41c204 response_code = 200 uri = /v2p
25232024-11-28T02:03:11.095ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25242024-11-28T02:03:11.100ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25252024-11-28T02:03:11.100ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_830b5e11-e6e4-4144-bc16-2396db6d872e
25262024-11-28T02:03:11.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60059
25272024-11-28T02:03:11.114ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25282024-11-28T02:03:11.114ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25292024-11-28T02:03:11.114ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:177
25302024-11-28T02:03:11.123ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:177
25312024-11-28T02:03:11.128ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25322024-11-28T02:03:11.128ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8
25332024-11-28T02:03:11.141ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25342024-11-28T02:03:11.141ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_89678a9e-6cf0-40f7-a395-8631085163d8
25352024-11-28T02:03:11.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59238
25362024-11-28T02:03:11.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59238 req_id = 5d7df152-0090-4ac7-b869-ab78e629cee8 response_code = 200 uri = /vpc-routes
25372024-11-28T02:03:11.162ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25382024-11-28T02:03:11.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108216 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43731 req_id = 63130535-6450-40f3-9270-a9d6ca642890 response_code = 204 uri = /switch-ports
25392024-11-28T02:03:11.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4494 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43731 req_id = 21eaced4-24e4-4eba-a2b7-544d89855c87 response_code = 200 uri = /network-bootstore-config
25402024-11-28T02:03:11.172ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25412024-11-28T02:03:11.172ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69
25422024-11-28T02:03:11.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54062
25432024-11-28T02:03:11.190ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25442024-11-28T02:03:11.190ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25452024-11-28T02:03:11.190ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25462024-11-28T02:03:11.190ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25472024-11-28T02:03:11.190ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25482024-11-28T02:03:11.190ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25492024-11-28T02:03:11.190ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25502024-11-28T02:03:11.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 757 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54062 req_id = 3f2eb5b0-76f3-4a6d-a711-e4f904b2d20e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25512024-11-28T02:03:11.192ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25522024-11-28T02:03:11.192ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be
25532024-11-28T02:03:11.204ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
25542024-11-28T02:03:11.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59238 req_id = 94e2e488-232d-4d16-b352-8c0138405c4d response_code = 204 uri = /eip-gateways
25552024-11-28T02:03:11.215ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25562024-11-28T02:03:11.215ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_830b5e11-e6e4-4144-bc16-2396db6d872e
25572024-11-28T02:03:11.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4446 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59238 req_id = e72ea4cd-1274-42e8-b565-6a765f3235bc response_code = 204 uri = /vpc-routes
25582024-11-28T02:03:11.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25592024-11-28T02:03:11.239ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25602024-11-28T02:03:11.240ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c9996824-866a-4451-99ce-f11f76d585ed
25612024-11-28T02:03:11.265ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25622024-11-28T02:03:11.265ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa
25632024-11-28T02:03:11.279ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25642024-11-28T02:03:11.279ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8
25652024-11-28T02:03:11.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193631 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64411 req_id = 3d6fc27d-c1b8-4a25-a4df-8f3db4db570d response_code = 204 uri = /switch-ports
25662024-11-28T02:03:11.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64411 req_id = ef053b11-aa38-45a0-8592-fe9a3cd6dd05 response_code = 200 uri = /network-bootstore-config
25672024-11-28T02:03:11.296ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25682024-11-28T02:03:11.296ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_60dc1266-4525-4b36-849d-835d2a02f170
25692024-11-28T02:03:11.310ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25702024-11-28T02:03:11.310ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be
25712024-11-28T02:03:11.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57818
25722024-11-28T02:03:11.318ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25732024-11-28T02:03:11.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25742024-11-28T02:03:11.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25752024-11-28T02:03:11.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25762024-11-28T02:03:11.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25772024-11-28T02:03:11.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25782024-11-28T02:03:11.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25792024-11-28T02:03:11.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57818 req_id = e56e270b-f4a3-4b8d-8f34-98b8753612f2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25802024-11-28T02:03:11.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58053
25812024-11-28T02:03:11.330ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25822024-11-28T02:03:11.330ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25832024-11-28T02:03:11.330ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/config/omicron-zones.json file = common/src/ledger.rs:177
25842024-11-28T02:03:11.331ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/config/omicron-zones.json file = common/src/ledger.rs:177
25852024-11-28T02:03:11.335ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25862024-11-28T02:03:11.335ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67
25872024-11-28T02:03:11.349ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25882024-11-28T02:03:11.349ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c9996824-866a-4451-99ce-f11f76d585ed
25892024-11-28T02:03:11.362ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89678a9e-6cf0-40f7-a395-8631085163d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25902024-11-28T02:03:11.362ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_89678a9e-6cf0-40f7-a395-8631085163d8
25912024-11-28T02:03:11.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336578 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52782 req_id = 3657dfb0-62d0-4c74-a442-824f1921d11d response_code = 200 uri = /inventory
25922024-11-28T02:03:11.388ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68b525e8-2570-4036-8a76-e2cc5b58fe69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25932024-11-28T02:03:11.388ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_68b525e8-2570-4036-8a76-e2cc5b58fe69
25942024-11-28T02:03:11.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48558
25952024-11-28T02:03:11.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48558 req_id = a857a085-48aa-4393-8f0d-52bfefefc318 response_code = 200 uri = /v2p
25962024-11-28T02:03:11.404ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25972024-11-28T02:03:11.404ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa
25982024-11-28T02:03:11.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61068
25992024-11-28T02:03:11.414ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26002024-11-28T02:03:11.422ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 830b5e11-e6e4-4144-bc16-2396db6d872e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26012024-11-28T02:03:11.422ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_830b5e11-e6e4-4144-bc16-2396db6d872e
26022024-11-28T02:03:11.438ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26032024-11-28T02:03:11.438ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_60dc1266-4525-4b36-849d-835d2a02f170
26042024-11-28T02:03:11.464ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26052024-11-28T02:03:11.467ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26062024-11-28T02:03:11.467ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67
26072024-11-28T02:03:11.484ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8bd68cbc-9e99-494b-97c8-bf6c88357db8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26082024-11-28T02:03:11.484ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8bd68cbc-9e99-494b-97c8-bf6c88357db8
26092024-11-28T02:03:11.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 386547 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60059 req_id = 7cd6524c-586f-4303-bf50-5a668a9ce6eb response_code = 200 uri = /inventory
26102024-11-28T02:03:11.510ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da2163f3-63fc-4f7b-b4fe-cdac494080be (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26112024-11-28T02:03:11.510ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da2163f3-63fc-4f7b-b4fe-cdac494080be
26122024-11-28T02:03:11.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115561 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61068 req_id = 862a254c-fe81-46a6-a1bb-ded15d6561d7 response_code = 204 uri = /switch-ports
26132024-11-28T02:03:11.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61068 req_id = c46cffdb-f942-4097-b483-6772f6dfaf3b response_code = 200 uri = /network-bootstore-config
26142024-11-28T02:03:11.538ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c9996824-866a-4451-99ce-f11f76d585ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26152024-11-28T02:03:11.538ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c9996824-866a-4451-99ce-f11f76d585ed
26162024-11-28T02:03:11.565ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b75d1286-8ea6-47b2-8976-e2951a13a6fa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26172024-11-28T02:03:11.565ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b75d1286-8ea6-47b2-8976-e2951a13a6fa
26182024-11-28T02:03:11.591ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 60dc1266-4525-4b36-849d-835d2a02f170 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26192024-11-28T02:03:11.591ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_60dc1266-4525-4b36-849d-835d2a02f170
26202024-11-28T02:03:11.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54616
26212024-11-28T02:03:11.596ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bdebcae5-93f8-4dda-99a8-d4a7f51c845c, kind: Service { id: 36d4f615-7461-4364-960c-89ece3aaabaf }, name: Name("external-dns-36d4f615-7461-4364-960c-89ece3aaabaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 1])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc93e5ec-9515-444a-bf62-fb07fd9a5d9d, kind: Service { id: eb274350-c0b0-4bce-9c8a-502880f2c905 }, name: Name("external-dns-eb274350-c0b0-4bce-9c8a-502880f2c905"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 17])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d932a551-47e5-4093-9823-e79bc6fd3354, kind: Service { id: 6392fcec-0540-4c8e-8fb9-a456637e79d1 }, name: Name("nexus-6392fcec-0540-4c8e-8fb9-a456637e79d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 213])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f17d445e-bb27-44c7-a47e-78951fc5205d, kind: Service { id: 2d033909-79ed-49ae-b11d-aeb32740cc17 }, name: Name("nexus-2d033909-79ed-49ae-b11d-aeb32740cc17"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 212])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa7a6292-a407-4f82-8188-c5971cd240ed, kind: Service { id: 2469a748-bcd2-4e0d-99cc-f79def0452cc }, name: Name("nexus-2469a748-bcd2-4e0d-99cc-f79def0452cc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 85])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26222024-11-28T02:03:11.596ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26232024-11-28T02:03:11.596ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26242024-11-28T02:03:11.596ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26252024-11-28T02:03:11.596ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26262024-11-28T02:03:11.596ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26272024-11-28T02:03:11.596ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26282024-11-28T02:03:11.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 740 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54616 req_id = ae6a63be-ed7d-4059-bacf-12bcf4855f55 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26292024-11-28T02:03:11.616ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26302024-11-28T02:03:11.616ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67
26312024-11-28T02:03:11.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58053 req_id = 605c93a0-db83-42ee-85ab-1bdad030677b response_code = 200 uri = /inventory
26322024-11-28T02:03:24.204ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7670 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 9fd2819f-3789-404b-bc7e-7bfc5faacf87 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
26332024-11-28T02:03:26.893ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48899
26342024-11-28T02:03:26.893ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48899 req_id = cf944a2d-fc84-428e-aa5d-5b194a30e5a5 response_code = 200 uri = /baseboard
26352024-11-28T02:03:40.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53456
26362024-11-28T02:03:40.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53456 req_id = 31b7ab21-16d8-49ee-981a-1b4161c3975f response_code = 200 uri = /vpc-routes
26372024-11-28T02:03:40.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
26382024-11-28T02:03:40.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53456 req_id = ff989349-8ef8-411c-b676-0e259b1d09ca response_code = 204 uri = /eip-gateways
26392024-11-28T02:03:40.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53456 req_id = cc47c5b0-1718-4d7c-8fbb-794fc8978612 response_code = 204 uri = /vpc-routes
26402024-11-28T02:03:40.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33000
26412024-11-28T02:03:40.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33000 req_id = 0a073311-7b31-4b42-b2db-fae93b35e02b response_code = 200 uri = /vpc-routes
26422024-11-28T02:03:40.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44936
26432024-11-28T02:03:40.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44936 req_id = e1383855-88d2-42a5-b76c-9ef97b3d0904 response_code = 200 uri = /v2p
26442024-11-28T02:03:40.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57481
26452024-11-28T02:03:40.720ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26462024-11-28T02:03:40.760ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26472024-11-28T02:03:40.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104412 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57481 req_id = 21ec6fd8-a00d-4ebe-b6dc-c9f49afad86e response_code = 204 uri = /switch-ports
26482024-11-28T02:03:40.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57127
26492024-11-28T02:03:40.824ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
26502024-11-28T02:03:40.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55028
26512024-11-28T02:03:40.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33000 req_id = d559d4b6-a0f5-4080-bfe1-265e78e5ab27 response_code = 204 uri = /eip-gateways
26522024-11-28T02:03:40.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38301
26532024-11-28T02:03:40.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57481 req_id = 8b93342f-0970-4e3d-95b2-0277cb21ee35 response_code = 200 uri = /network-bootstore-config
26542024-11-28T02:03:40.825ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26552024-11-28T02:03:40.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38301 req_id = 5a9b5c19-30eb-41af-8a8a-d78bb7fe1fe5 response_code = 200 uri = /vpc-routes
26562024-11-28T02:03:40.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57127 req_id = 8a4842bd-08c8-42c0-ab68-0d9c7cf6ab2e response_code = 200 uri = /v2p
26572024-11-28T02:03:40.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33000 req_id = eb957fc6-2ddd-4e3c-9df8-f2023833e32a response_code = 204 uri = /vpc-routes
26582024-11-28T02:03:40.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26592024-11-28T02:03:40.882ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
26602024-11-28T02:03:40.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38301 req_id = 8aed6114-968c-415d-9e45-062294302201 response_code = 204 uri = /eip-gateways
26612024-11-28T02:03:40.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38301 req_id = e7d7d0f2-6fa7-495e-a984-53957e5fce48 response_code = 204 uri = /vpc-routes
26622024-11-28T02:03:40.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55028 req_id = 473df4f1-fb12-4aa4-815b-b925d3cc42fe response_code = 204 uri = /switch-ports
26632024-11-28T02:03:40.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55028 req_id = 8a72afb8-feae-4f4e-84ee-822481f8a647 response_code = 200 uri = /network-bootstore-config
26642024-11-28T02:03:40.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37007
26652024-11-28T02:03:40.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37007 req_id = 917665a8-a9c0-47e1-995d-d4168132e9a5 response_code = 200 uri = /v2p
26662024-11-28T02:03:40.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56190
26672024-11-28T02:03:40.996ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26682024-11-28T02:03:41.031ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26692024-11-28T02:03:41.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89068 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56190 req_id = b067a0a9-960f-452d-bddb-f3c0a5030e70 response_code = 204 uri = /switch-ports
26702024-11-28T02:03:41.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56190 req_id = 903aa7b0-cf21-4af8-9a98-1d2abb80d94d response_code = 200 uri = /network-bootstore-config
26712024-11-28T02:03:54.205ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9031 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = 9d50ed46-751b-490f-b32c-6003b0dc4570 response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
26722024-11-28T02:03:56.925ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39534
26732024-11-28T02:03:56.926ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39534 req_id = 015ee4c4-c064-4442-9ce5-2184fb733608 response_code = 200 uri = /baseboard
26742024-11-28T02:04:10.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51687
26752024-11-28T02:04:10.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51687 req_id = 099a0459-caf3-4ed6-9fc6-adb1a61f8c53 response_code = 200 uri = /vpc-routes
26762024-11-28T02:04:10.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45161
26772024-11-28T02:04:10.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45161 req_id = bdf23666-9c32-41a5-8f88-aecb113a7303 response_code = 200 uri = /vpc-routes
26782024-11-28T02:04:10.878ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
26792024-11-28T02:04:10.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45161 req_id = f611d6bc-7e29-487e-ac2a-cd79de059bdd response_code = 204 uri = /eip-gateways
26802024-11-28T02:04:10.879ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
26812024-11-28T02:04:10.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51687 req_id = 110aeab4-0f20-46d2-9325-907cbe9d1a50 response_code = 204 uri = /eip-gateways
26822024-11-28T02:04:10.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45161 req_id = acb72cc9-6d67-419c-ac8c-6e71092f7ab2 response_code = 204 uri = /vpc-routes
26832024-11-28T02:04:10.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51687 req_id = 68cdd3f8-82e7-46c4-9761-587f3a198c4b response_code = 204 uri = /vpc-routes
26842024-11-28T02:04:10.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63504
26852024-11-28T02:04:10.966ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26862024-11-28T02:04:11.005ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26872024-11-28T02:04:11.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96874 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63504 req_id = 8acc99f1-04ec-4cbd-bbde-8e894e2600fd response_code = 204 uri = /switch-ports
26882024-11-28T02:04:11.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58366
26892024-11-28T02:04:11.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44070
26902024-11-28T02:04:11.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63504 req_id = 2d38c8f4-1ec8-4a2f-a9dc-30b8ea52522a response_code = 200 uri = /network-bootstore-config
26912024-11-28T02:04:11.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44070 req_id = 9e823098-218d-4907-9b79-aef98df9cbc1 response_code = 200 uri = /v2p
26922024-11-28T02:04:11.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58366 req_id = 3db14f65-ba9a-493b-9171-3a5a1d088c18 response_code = 200 uri = /v2p
26932024-11-28T02:04:11.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62460
26942024-11-28T02:04:11.113ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26952024-11-28T02:04:11.153ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26962024-11-28T02:04:11.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116541 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62460 req_id = 58ae7ea8-0828-48b8-8fe4-b975ae18a299 response_code = 204 uri = /switch-ports
26972024-11-28T02:04:11.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62460 req_id = 60c00010-2c4c-4844-965f-a9e17ff98bb7 response_code = 200 uri = /network-bootstore-config
26982024-11-28T02:04:11.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40757
26992024-11-28T02:04:11.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40757 req_id = 431cd772-4a44-4789-a06a-a3938af63198 response_code = 200 uri = /vpc-routes
27002024-11-28T02:04:11.394ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
27012024-11-28T02:04:11.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40757 req_id = 8b81fcad-7738-43dd-b03f-e6b758837bb6 response_code = 204 uri = /eip-gateways
27022024-11-28T02:04:11.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40757 req_id = 5f1063e3-a81f-4595-b2d3-1ce9df431074 response_code = 204 uri = /vpc-routes
27032024-11-28T02:04:11.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61911
27042024-11-28T02:04:11.416ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27052024-11-28T02:04:11.456ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27062024-11-28T02:04:11.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96342 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61911 req_id = 2262daca-1589-4c31-8b12-7eb2733851ec response_code = 204 uri = /switch-ports
27072024-11-28T02:04:11.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64888
27082024-11-28T02:04:11.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61911 req_id = 04c575b4-664c-49d4-9085-e654c261ae7e response_code = 200 uri = /network-bootstore-config
27092024-11-28T02:04:11.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64888 req_id = 206b9988-58eb-4ea3-96b5-bede689137ed response_code = 200 uri = /v2p
27102024-11-28T02:04:16.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36928
27112024-11-28T02:04:16.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36928 req_id = 4672fd4a-d0e9-4f9f-9dc0-845b2003d473 response_code = 200 uri = /v2p
27122024-11-28T02:04:16.634ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(16308709) }
27132024-11-28T02:04:16.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4820 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36928 req_id = b3db7e2d-7bb1-4ea2-b70d-277bb4ad12bd response_code = 204 uri = /v2p
27142024-11-28T02:04:16.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58143
27152024-11-28T02:04:16.748ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 72e78d15-33bc-4519-9d15-3e4071491759, kind: Instance { id: 754b28bf-6c2b-4d04-be10-941b3bfa03d8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16308709), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72e78d15-33bc-4519-9d15-3e4071491759, kind: Instance { id: 754b28bf-6c2b-4d04-be10-941b3bfa03d8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16308709), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72e78d15-33bc-4519-9d15-3e4071491759, kind: Instance { id: 754b28bf-6c2b-4d04-be10-941b3bfa03d8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16308709), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16308709))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72e78d15-33bc-4519-9d15-3e4071491759, kind: Instance { id: 754b28bf-6c2b-4d04-be10-941b3bfa03d8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16308709), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-b2e1f0e28f1", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 43150271-7344-4806-83fd-0760823a1ab2, read_only_parent: Some(Volume { block_size: 512, id: 1de5591e-3630-43e2-b218-075e15f5212c, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7aeecefd-b943-4a10-a7a1-f5613856c79d, key: Some("RcMjSLvEvdwFrtzS5Y9Lwvd7bIHyIK8Fz+FCjpLBwN8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 43150271-7344-4806-83fd-0760823a1ab2, key: Some("GGipYqbRgaXNqvzMEIpf8EA0vRx1grqZ1lKLUeaDok0="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::17]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-b2e1f0e28f1" }] }), cloud_init_bytes: Some(..) } instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 metadata = InstanceMetadata { silo_id: 7e159834-997a-4c03-b9db-1e91d783221c, project_id: 4e06baac-07fc-4792-8ebe-158a470fd7b6 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-28T02:04:16.734365942Z }
27162024-11-28T02:04:16.748ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 migration_id = None propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27172024-11-28T02:04:16.749ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 migration_id = None propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 72e78d15-33bc-4519-9d15-3e4071491759, kind: Instance { id: 754b28bf-6c2b-4d04-be10-941b3bfa03d8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16308709), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72e78d15-33bc-4519-9d15-3e4071491759, kind: Instance { id: 754b28bf-6c2b-4d04-be10-941b3bfa03d8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16308709), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72e78d15-33bc-4519-9d15-3e4071491759, kind: Instance { id: 754b28bf-6c2b-4d04-be10-941b3bfa03d8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16308709), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16308709))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72e78d15-33bc-4519-9d15-3e4071491759, kind: Instance { id: 754b28bf-6c2b-4d04-be10-941b3bfa03d8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16308709), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-b2e1f0e28f1", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 43150271-7344-4806-83fd-0760823a1ab2, read_only_parent: Some(Volume { block_size: 512, id: 1de5591e-3630-43e2-b218-075e15f5212c, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7aeecefd-b943-4a10-a7a1-f5613856c79d, key: Some("RcMjSLvEvdwFrtzS5Y9Lwvd7bIHyIK8Fz+FCjpLBwN8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 43150271-7344-4806-83fd-0760823a1ab2, key: Some("GGipYqbRgaXNqvzMEIpf8EA0vRx1grqZ1lKLUeaDok0="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::17]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-b2e1f0e28f1" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-28T02:04:16.734365942Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27182024-11-28T02:04:16.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58143 req_id = 44dfbf9b-2484-4616-b6ad-55aca410ca11 response_code = 200 uri = /vmms/7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27192024-11-28T02:04:16.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55538
27202024-11-28T02:04:16.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 835 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55538 req_id = 8cef6505-a160-4e95-8fd0-9817ca38e17b response_code = 200 uri = /vmms/7001f3a3-3a22-4fd6-a06f-efde5d6ec855/state
27212024-11-28T02:04:16.864ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 16308709 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27222024-11-28T02:04:16.864ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27232024-11-28T02:04:16.899ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855 file = illumos-utils/src/zone.rs:325 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27242024-11-28T02:04:16.924ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855 file = illumos-utils/src/zone.rs:363 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27252024-11-28T02:04:16.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36146
27262024-11-28T02:04:16.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36146 req_id = ec15f496-8a6b-4a10-99e6-872f480aefe9 response_code = 200 uri = /vpc-routes
27272024-11-28T02:04:16.982ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {72e78d15-33bc-4519-9d15-3e4071491759: {10.151.2.175: {b37eaf51-00a7-4d94-9ed6-fae8cf836ab7}, 10.151.2.176: {b37eaf51-00a7-4d94-9ed6-fae8cf836ab7}}} }
27282024-11-28T02:04:18.426ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27292024-11-28T02:04:18.427ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 zone = oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27302024-11-28T02:04:18.628ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855") failed: Property not found. retry in 73.992567ms file = illumos-utils/src/svc.rs:36 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 zone = oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27312024-11-28T02:04:18.717ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855") failed: Property not found. retry in 144.656617ms file = illumos-utils/src/svc.rs:36 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 zone = oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27322024-11-28T02:04:18.887ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855") failed: Property not found. retry in 186.79089ms file = illumos-utils/src/svc.rs:36 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 zone = oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27332024-11-28T02:04:19.085ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855") failed: Property not found. retry in 348.372846ms file = illumos-utils/src/svc.rs:36 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 zone = oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27342024-11-28T02:04:19.449ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855") failed: Property not found. retry in 409.245727ms file = illumos-utils/src/svc.rs:36 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 zone = oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27352024-11-28T02:04:19.873ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855") failed: Property not found. retry in 1.439279824s file = illumos-utils/src/svc.rs:36 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 zone = oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27362024-11-28T02:04:21.324ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855") failed: Property not found. retry in 1.324455467s file = illumos-utils/src/svc.rs:36 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 zone = oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27372024-11-28T02:04:22.659ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855") failed: Property not found. retry in 1.178114415s file = illumos-utils/src/svc.rs:36 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 zone = oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27382024-11-28T02:04:23.866ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855 file = sled-agent/src/instance.rs:1786 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27392024-11-28T02:04:23.875ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855") failed: Property not found. retry in 28.673218ms file = illumos-utils/src/svc.rs:36 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27402024-11-28T02:04:23.913ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855") failed: Property not found. retry in 145.235404ms file = illumos-utils/src/svc.rs:36 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27412024-11-28T02:04:24.068ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27422024-11-28T02:04:24.114ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27432024-11-28T02:04:24.204ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8174 local_addr = [fd00:1122:3344:101::1]:57643 method = GET remote_addr = [fd00:1122:3344:101::d]:39115 req_id = fb9acf29-2a12-44b5-9bb8-f99b88a3649e response_code = 200 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 uri = /313847b3-d670-4167-9b09-9e7d3dfcb2a4
27442024-11-28T02:04:24.259ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27452024-11-28T02:04:24.260ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-28T02:04:24.260553404Z } file = sled-agent/src/instance.rs:780 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27462024-11-28T02:04:24.260ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-28T02:04:24.260553404Z } propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27472024-11-28T02:04:24.260ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
27482024-11-28T02:04:24.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7281600 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36146 req_id = 82d2a318-cd81-4762-8085-d91365dd32f2 response_code = 204 uri = /eip-gateways
27492024-11-28T02:04:24.261ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-28T02:04:24.260553404Z }, migration_in: None, migration_out: None }
27502024-11-28T02:04:24.305ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-28T02:04:24.305107638Z } file = sled-agent/src/instance.rs:780 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27512024-11-28T02:04:24.305ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-28T02:04:24.305107638Z } propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27522024-11-28T02:04:24.305ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-28T02:04:24.305107638Z }, migration_in: None, migration_out: None }
27532024-11-28T02:04:24.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 424 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36146 req_id = c2ab3617-ea0b-4ecc-ba50-248c1bffecd5 response_code = 204 uri = /vpc-routes
27542024-11-28T02:04:26.959ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47704
27552024-11-28T02:04:26.959ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47704 req_id = 80e65a15-c961-4260-9944-b8056a5d00fa response_code = 200 uri = /baseboard
27562024-11-28T02:04:34.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36439
27572024-11-28T02:04:34.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 634 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36439 req_id = 2886caee-69b5-424d-8423-8ba55fd0aa9a response_code = 200 uri = /vmms/7001f3a3-3a22-4fd6-a06f-efde5d6ec855/state
27582024-11-28T02:04:34.428ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-28T02:04:34.428798846Z } file = sled-agent/src/instance.rs:780 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27592024-11-28T02:04:34.428ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-28T02:04:34.428798846Z } propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27602024-11-28T02:04:34.428ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-28T02:04:34.428798846Z }, migration_in: None, migration_out: None }
27612024-11-28T02:04:34.489ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-28T02:04:34.489792245Z } file = sled-agent/src/instance.rs:780 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27622024-11-28T02:04:34.489ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-28T02:04:34.489792245Z } propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27632024-11-28T02:04:34.489ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27642024-11-28T02:04:34.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27652024-11-28T02:04:34.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27662024-11-28T02:04:34.491ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 138205906591426680 n_samples = 6 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
27672024-11-28T02:04:34.491ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 4685223989681274462 n_samples = 6 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
27682024-11-28T02:04:34.491ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/76f1d962-0f92-42e6-af9d-3f59d408bbbd/debug/bundle/zone", "/pool/int/b10d5a12-f0d1-4561-881b-d6c57310fb97/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/89678a9e-6cf0-40f7-a395-8631085163d8/crypt/debug", "/pool/ext/68b525e8-2570-4036-8a76-e2cc5b58fe69/crypt/debug", "/pool/ext/830b5e11-e6e4-4144-bc16-2396db6d872e/crypt/debug", "/pool/ext/8bd68cbc-9e99-494b-97c8-bf6c88357db8/crypt/debug", "/pool/ext/da2163f3-63fc-4f7b-b4fe-cdac494080be/crypt/debug", "/pool/ext/c9996824-866a-4451-99ce-f11f76d585ed/crypt/debug", "/pool/ext/b75d1286-8ea6-47b2-8976-e2951a13a6fa/crypt/debug", "/pool/ext/60dc1266-4525-4b36-849d-835d2a02f170/crypt/debug", "/pool/ext/d2fd19a1-ef8d-40d5-9bfa-ad9bc8d2ba67/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27692024-11-28T02:04:35.118ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855", bundle_id: bf2842fe-b62e-4ccb-9d65-68ecc50d987d }, time_created: 2024-11-28T02:04:34.492879819Z, version: 0, cause: TerminatedInstance }
27702024-11-28T02:04:35.118ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_7001f3a3-3a22-4fd6-a06f-efde5d6ec855 file = sled-agent/src/instance.rs:1032 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27712024-11-28T02:04:36.895ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27722024-11-28T02:04:36.910ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(16308709), kind: System }
27732024-11-28T02:04:36.910ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(16308709), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27742024-11-28T02:04:36.911ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-28T02:04:36.911491548Z }, migration_in: None, migration_out: None }
27752024-11-28T02:04:36.937ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-28T02:04:36.911491548Z }, migration_in: None, migration_out: None }
27762024-11-28T02:04:36.941ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 754b28bf-6c2b-4d04-be10-941b3bfa03d8 propolis_id = 7001f3a3-3a22-4fd6-a06f-efde5d6ec855
27772024-11-28T02:04:37.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37108
27782024-11-28T02:04:37.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37108 req_id = 52ebc99a-ecd3-4086-bbf4-8f3ae2eddee0 response_code = 200 uri = /vpc-routes
27792024-11-28T02:04:37.456ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {72e78d15-33bc-4519-9d15-3e4071491759: {10.151.2.175: {b37eaf51-00a7-4d94-9ed6-fae8cf836ab7}, 10.151.2.176: {b37eaf51-00a7-4d94-9ed6-fae8cf836ab7}}} }
27802024-11-28T02:04:37.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37108 req_id = 3f358c6b-e78c-4d2d-a4af-531014954b86 response_code = 204 uri = /eip-gateways
27812024-11-28T02:04:37.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37108 req_id = 8f5bcf07-a794-4354-875f-fbe54a46f0d2 response_code = 204 uri = /vpc-routes
27822024-11-28T02:04:37.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38282
27832024-11-28T02:04:37.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38282 req_id = 44cc127f-b23d-456b-9b55-2ccce2a21812 response_code = 200 uri = /v2p
27842024-11-28T02:04:38.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38244
27852024-11-28T02:04:38.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38244 req_id = a9d9856d-0a41-4b00-83af-b691fc62fedc response_code = 200 uri = /v2p
27862024-11-28T02:04:38.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58600
27872024-11-28T02:04:38.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58600 req_id = 49f73361-3f70-46cc-80cb-f8f77d59022b response_code = 200 uri = /vpc-routes
27882024-11-28T02:04:38.988ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
27892024-11-28T02:04:38.988ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4
27902024-11-28T02:04:38.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58600 req_id = 4d5a0704-ad5f-414b-9cb6-9d877252c6ee response_code = 204 uri = /eip-gateways
27912024-11-28T02:04:38.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58600 req_id = 792abbff-3815-4b76-8318-313a0994f04b response_code = 204 uri = /vpc-routes
27922024-11-28T02:04:39.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64495
27932024-11-28T02:04:39.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64495 req_id = 3da3b2c2-c27c-41a1-8c9b-7eb3d964980c response_code = 200 uri = /vpc-routes
27942024-11-28T02:04:39.643ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
27952024-11-28T02:04:39.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64495 req_id = 60fc6004-8916-4cc7-ac5c-9797f7b80059 response_code = 204 uri = /eip-gateways
27962024-11-28T02:04:39.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64495 req_id = c76f8ee8-74ba-49ff-b61b-d8040ce6a4c7 response_code = 204 uri = /vpc-routes
27972024-11-28T02:04:40.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64379
27982024-11-28T02:04:40.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64379 req_id = d6ff508e-f11c-4a9b-a9db-5c1cf98d4c21 response_code = 200 uri = /vpc-routes
27992024-11-28T02:04:40.633ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
28002024-11-28T02:04:40.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64379 req_id = 7dfb4e69-db67-4f3d-90fb-152df2d62331 response_code = 204 uri = /eip-gateways
28012024-11-28T02:04:40.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38419
28022024-11-28T02:04:40.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38419 req_id = dfcd4784-55da-4612-9fa6-c2f6c30a3156 response_code = 200 uri = /vpc-routes
28032024-11-28T02:04:40.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64379 req_id = 5fe00f4f-8bcd-4a84-8c86-ff3a6586f929 response_code = 204 uri = /vpc-routes
28042024-11-28T02:04:40.701ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
28052024-11-28T02:04:40.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38419 req_id = 23571078-ff33-4b27-9b9b-c4589b170fb1 response_code = 204 uri = /eip-gateways
28062024-11-28T02:04:40.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38419 req_id = 5aab0246-3f36-4427-b41f-68ff0aeec47a response_code = 204 uri = /vpc-routes
28072024-11-28T02:04:40.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51424
28082024-11-28T02:04:40.758ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28092024-11-28T02:04:40.800ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28102024-11-28T02:04:40.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108091 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51424 req_id = 0f8ed915-52bd-4d52-ace6-5efedeab41ed response_code = 204 uri = /switch-ports
28112024-11-28T02:04:40.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63789
28122024-11-28T02:04:40.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65389
28132024-11-28T02:04:40.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51424 req_id = fbc0eed9-8012-4ca4-95de-67efcf3d0e93 response_code = 200 uri = /network-bootstore-config
28142024-11-28T02:04:40.866ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28152024-11-28T02:04:40.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3803 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63789 req_id = 53d2d308-d982-4ab2-b5cc-64f4c7a6c64b response_code = 200 uri = /v2p
28162024-11-28T02:04:40.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36018
28172024-11-28T02:04:40.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36018 req_id = 11b8382c-2dc5-4380-8cd5-02c45ca3bee6 response_code = 200 uri = /vpc-routes
28182024-11-28T02:04:40.903ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28192024-11-28T02:04:40.911ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 313847b3-d670-4167-9b09-9e7d3dfcb2a4 values = ExternalIpGatewayMap { mappings: {} }
28202024-11-28T02:04:40.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36018 req_id = 3c752d8d-1300-438d-b316-ea83b4d43831 response_code = 204 uri = /eip-gateways
28212024-11-28T02:04:40.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 735 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36018 req_id = 488f35d9-d2f1-4468-997e-797babce25b1 response_code = 204 uri = /vpc-routes
28222024-11-28T02:04:40.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54764
28232024-11-28T02:04:40.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54764 req_id = 15d6fec9-0c96-48ba-81df-9007382e3737 response_code = 200 uri = /v2p
28242024-11-28T02:04:40.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97711 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65389 req_id = 3545b58f-b0c4-4a80-af45-6848cd668c0b response_code = 204 uri = /switch-ports
28252024-11-28T02:04:40.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65389 req_id = 0a9d653e-182f-4da3-b01d-974bb75a9b85 response_code = 200 uri = /network-bootstore-config
28262024-11-28T02:04:40.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57908
28272024-11-28T02:04:40.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57908 req_id = 39d3a64c-a551-4434-90ce-4f3847eb4ae9 response_code = 200 uri = /v2p
28282024-11-28T02:04:41.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36377
28292024-11-28T02:04:41.019ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28302024-11-28T02:04:41.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28312024-11-28T02:04:41.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36377 req_id = 1b7f3b8a-7dd6-4e94-9486-97428b4713ff response_code = 204 uri = /switch-ports
28322024-11-28T02:04:41.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36377 req_id = 5fd6107c-c380-465d-99ef-ac2ebd433974 response_code = 200 uri = /network-bootstore-config