Max level shown:
1 [ Nov 22 20:27:18 Enabled. ]
2 [ Nov 22 20:27:18 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 22 20:27:18 Method "start" exited with status 0. ]
4 [ Nov 22 20:27:18 Rereading configuration. ]
5 [ Nov 22 20:27:18 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-22T20:27:18.248ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-22T20:27:18.248ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-22T20:27:18.302ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-22T20:27:18.302ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-22T20:27:18.418ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-22T20:27:18.427ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-22T20:27:18.435ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-22T20:27:19.038ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-22T20:27:19.177ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-22T20:27:19.177ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-22T20:27:19.177ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-22T20:27:19.177ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-22T20:27:19.177ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-22T20:27:19.177ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-22T20:27:19.181ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-22T20:27:19.181ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-22T20:27:19.181ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-22T20:27:19.181ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-22T20:27:19.181ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-22T20:27:19.181ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-22T20:27:19.181ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-22T20:27:19.181ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-22T20:27:19.181ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-22T20:27:19.193ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-22T20:27:19.193ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool)
322024-11-22T20:27:19.296ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal }
332024-11-22T20:27:19.771ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-22T20:27:19.771ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-22T20:27:19.771ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-22T20:27:19.771ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-22T20:27:19.771ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-22T20:27:19.771ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-22T20:27:19.771ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-22T20:27:19.780ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-22T20:27:19.780ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool)
422024-11-22T20:27:19.871ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal }
432024-11-22T20:27:20.346ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-22T20:27:20.346ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-22T20:27:20.346ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
462024-11-22T20:27:20.346ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
472024-11-22T20:27:20.346ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482024-11-22T20:27:20.346ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492024-11-22T20:27:20.346ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-22T20:27:20.346ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
512024-11-22T20:27:20.346ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
522024-11-22T20:27:20.347ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-11-22T20:27:20.347ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-22T20:27:20.347ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-22T20:27:20.347ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-11-22T20:27:20.347ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-22T20:27:20.347ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-22T20:27:20.347ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-11-22T20:27:20.347ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-11-22T20:27:20.347ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-11-22T20:27:20.347ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-22T20:27:20.347ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-22T20:27:20.347ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-22T20:27:20.347ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-22T20:27:20.347ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-22T20:27:20.347ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
752024-11-22T20:27:20.347ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-11-22T20:27:20.347ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772024-11-22T20:27:20.347ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
782024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
792024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
802024-11-22T20:27:20.347ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-22T20:27:20.347ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-11-22T20:27:20.347ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
832024-11-22T20:27:20.347ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-11-22T20:27:20.347ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
852024-11-22T20:27:20.347ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
862024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
872024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
882024-11-22T20:27:20.347ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-11-22T20:27:20.347ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
902024-11-22T20:27:20.347ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
912024-11-22T20:27:20.347ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
922024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-11-22T20:27:20.347ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-11-22T20:27:20.347ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
962024-11-22T20:27:20.347ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
972024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
982024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
992024-11-22T20:27:20.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1002024-11-22T20:27:20.347ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-11-22T20:27:20.347ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1032024-11-22T20:27:20.347ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1042024-11-22T20:27:20.347ZINFOSledAgent (bootstore): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-sock-i86pc
1052024-11-22T20:27:20.347ZINFOSledAgent (bootstore): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-sock-i86pc
1062024-11-22T20:27:20.347ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-22T20:27:20.347ZINFOSledAgent (bootstore): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-sock-i86pc
1082024-11-22T20:27:20.347ZINFOSledAgent (bootstore): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-sock-i86pc
1092024-11-22T20:27:20.347ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-22T20:27:20.347ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-22T20:27:20.347ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-22T20:27:20.358ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:743
1132024-11-22T20:27:20.358ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3999, tv_nsec: 317469517 } time_to_next_cleanup = 599.999925868s
1142024-11-22T20:27:20.358ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
1152024-11-22T20:27:20.358ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-22T20:27:20.358ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/sled-agent-request.json file = common/src/ledger.rs:189
1172024-11-22T20:27:20.361ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/sled-agent-request.json file = common/src/ledger.rs:189
1182024-11-22T20:27:20.361ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-22T20:27:20.363ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-22T20:27:20.364ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-22T20:27:20.364ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-22T20:27:20.364ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-22T20:27:20.364ZINFOSledAgent (RSS): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1242024-11-22T20:27:20.364ZINFOSledAgent (RSS): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1252024-11-22T20:27:20.364ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-22T20:27:20.364ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-22T20:27:20.364ZINFOSledAgent (RSS): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/rss-sled-plan.json file = common/src/ledger.rs:189
1282024-11-22T20:27:20.364ZINFOSledAgent (RSS): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/rss-sled-plan.json file = common/src/ledger.rs:189
1292024-11-22T20:27:20.364ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-22T20:27:20.364ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-22T20:27:20.364ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-22T20:27:20.364ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-22T20:27:20.364ZINFOSledAgent (RSS): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1342024-11-22T20:27:20.364ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/rss-sled-plan.json"
1352024-11-22T20:27:20.364ZINFOSledAgent (RSS): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1362024-11-22T20:27:20.365ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/rss-sled-plan.json"
1372024-11-22T20:27:20.365ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 8dcc32b6-a955-403f-b8f5-2d130f25dc49, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 714aeaa4-2ee3-4359-b59d-b4bb953043b4 (sled), rack_id: 8dcc32b6-a955-403f-b8f5-2d130f25dc49, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1382024-11-22T20:27:20.365ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1392024-11-22T20:27:20.365ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1402024-11-22T20:27:20.365ZINFOSledAgent (bootstore): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-sock-i86pc
1412024-11-22T20:27:20.365ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/cluster/bootstore-network-config.json" peer_id = pc-sock-i86pc
1422024-11-22T20:27:20.365ZINFOSledAgent (bootstore): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-sock-i86pc
1432024-11-22T20:27:20.365ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/cluster/bootstore-network-config.json" peer_id = pc-sock-i86pc
1442024-11-22T20:27:20.365ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1452024-11-22T20:27:20.365ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 714aeaa4-2ee3-4359-b59d-b4bb953043b4 (sled), rack_id: 8dcc32b6-a955-403f-b8f5-2d130f25dc49, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1462024-11-22T20:27:20.365ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4302
1472024-11-22T20:27:20.366ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4702
1482024-11-22T20:27:20.370ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1492024-11-22T20:27:20.376ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1502024-11-22T20:27:20.376ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1512024-11-22T20:27:20.380ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1522024-11-22T20:27:20.381ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1532024-11-22T20:27:20.381ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:53433
1542024-11-22T20:27:20.381ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 714aeaa4-2ee3-4359-b59d-b4bb953043b4 (sled), rack_id: 8dcc32b6-a955-403f-b8f5-2d130f25dc49, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1552024-11-22T20:27:20.381ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1562024-11-22T20:27:20.381ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1572024-11-22T20:27:20.381ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1582024-11-22T20:27:20.381ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1592024-11-22T20:27:20.381ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1602024-11-22T20:27:20.381ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1612024-11-22T20:27:20.381ZINFOSledAgent (StorageManager): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1622024-11-22T20:27:20.381ZINFOSledAgent (StorageManager): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1632024-11-22T20:27:20.381ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1642024-11-22T20:27:20.381ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1652024-11-22T20:27:20.381ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1662024-11-22T20:27:20.381ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1672024-11-22T20:27:20.381ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1682024-11-22T20:27:20.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-22T20:27:20.417ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1702024-11-22T20:27:20.432ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:407 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
1712024-11-22T20:27:20.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1722024-11-22T20:27:20.433ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:419 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
1732024-11-22T20:27:20.433ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742024-11-22T20:27:20.436ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 130.479ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "23ebe024-e4be-4987-ac67-f815471b7667", "content-length": "124", "date": "Fri, 22 Nov 2024 20:27:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "23ebe024-e4be-4987-ac67-f815471b7667" } file = clients/ddm-admin-client/src/lib.rs:177
1752024-11-22T20:27:20.436ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1762024-11-22T20:27:20.446ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_5b2602eb-7e15-49ac-949a-e1f7df8df0ca/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1772024-11-22T20:27:20.471ZINFOSledAgent: successfully created encrypted zvol: name="oxi_5b2602eb-7e15-49ac-949a-e1f7df8df0ca/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-11-22T20:27:20.471ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_5b2602eb-7e15-49ac-949a-e1f7df8df0ca/swap" file = sled-agent/src/swap_device.rs:96
1792024-11-22T20:27:20.476ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:434 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
1802024-11-22T20:27:20.476ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1812024-11-22T20:27:20.476ZINFOSledAgent (BackingFs): Ensuring dataset oxi_5b2602eb-7e15-49ac-949a-e1f7df8df0ca/backing/fmd file = sled-agent/src/backing_fs.rs:138
1822024-11-22T20:27:20.565ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1832024-11-22T20:27:20.567ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-11-22T20:27:20.568ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 143.848208ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6f4229ef-e475-4530-be04-84717f145d0b", "content-length": "124", "date": "Fri, 22 Nov 2024 20:27:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6f4229ef-e475-4530-be04-84717f145d0b" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-11-22T20:27:20.713ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-11-22T20:27:20.714ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 191.411841ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cfd31db5-749f-46bc-a0fb-5af9f5a35e2d", "content-length": "124", "date": "Fri, 22 Nov 2024 20:27:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cfd31db5-749f-46bc-a0fb-5af9f5a35e2d" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-11-22T20:27:20.784ZINFOSledAgent (BackingFs): Mounting oxi_5b2602eb-7e15-49ac-949a-e1f7df8df0ca/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1882024-11-22T20:27:20.797ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1892024-11-22T20:27:20.797ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1902024-11-22T20:27:20.797ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1912024-11-22T20:27:20.797ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1922024-11-22T20:27:20.905ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-22T20:27:20.907ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 90.828914ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9244147e-1863-463b-ae8a-f0833d4ce406", "content-length": "124", "date": "Fri, 22 Nov 2024 20:27:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9244147e-1863-463b-ae8a-f0833d4ce406" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-22T20:27:20.997ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-22T20:27:20.998ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 205.636359ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "91d8d0d1-b9fc-4c3b-bff9-c1cc6dfd1a3d", "content-length": "124", "date": "Fri, 22 Nov 2024 20:27:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "91d8d0d1-b9fc-4c3b-bff9-c1cc6dfd1a3d" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-22T20:27:21.205ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1972024-11-22T20:27:21.205ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 205.167227ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bdfefade-2aba-4937-8aa2-65494972f98f", "content-length": "124", "date": "Fri, 22 Nov 2024 20:27:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bdfefade-2aba-4937-8aa2-65494972f98f" } file = clients/ddm-admin-client/src/lib.rs:177
1982024-11-22T20:27:21.412ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1992024-11-22T20:27:21.413ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 363.902734ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6a7af7b0-fb1d-4977-aad3-f0b1416fd4da", "content-length": "124", "date": "Fri, 22 Nov 2024 20:27:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6a7af7b0-fb1d-4977-aad3-f0b1416fd4da" } file = clients/ddm-admin-client/src/lib.rs:177
2002024-11-22T20:27:21.531ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2012024-11-22T20:27:21.536ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:57404 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2022024-11-22T20:27:21.536ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2032024-11-22T20:27:21.536ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:57404 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2042024-11-22T20:27:21.537ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 357.691834ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2052024-11-22T20:27:21.538ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2062024-11-22T20:27:21.538ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2072024-11-22T20:27:21.539ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:927 underlay_address = fd00:1122:3344:101::1
2082024-11-22T20:27:21.539ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2092024-11-22T20:27:21.778ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2102024-11-22T20:27:21.897ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 612.961459ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2112024-11-22T20:27:22.511ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.350412329s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2122024-11-22T20:27:23.863ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.415435735s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2132024-11-22T20:27:24.242ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2676
2142024-11-22T20:27:24.242ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2921
2152024-11-22T20:27:24.242ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2546
2162024-11-22T20:27:24.242ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2593
2172024-11-22T20:27:24.242ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3002
2182024-11-22T20:27:24.242ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3047
2192024-11-22T20:27:24.244ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2846
2202024-11-22T20:27:24.245ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2587
2212024-11-22T20:27:24.245ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='2500dc24-e0ec-44d0-a833-c5be2bf7b3d6'/> <propval type="astring" name="rack_id" value='8dcc32b6-a955-403f-b8f5-2d130f25dc49'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe5a:385'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='8dcc32b6-a955-403f-b8f5-2d130f25dc49'/> <propval type="astring" name="sled_id" value='714aeaa4-2ee3-4359-b59d-b4bb953043b4'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='714aeaa4-2ee3-4359-b59d-b4bb953043b4'/> <propval type="astring" name="rack_uuid" value='8dcc32b6-a955-403f-b8f5-2d130f25dc49'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='714aeaa4-2ee3-4359-b59d-b4bb953043b4'/> <propval type="astring" name="rack_uuid" value='8dcc32b6-a955-403f-b8f5-2d130f25dc49'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2222024-11-22T20:27:24.245ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2232024-11-22T20:27:24.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 56.382054ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-22T20:27:24.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 115.628337ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-22T20:27:24.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 134.441771ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-22T20:27:25.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 210.750777ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-22T20:27:25.280ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.939709374s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2282024-11-22T20:27:25.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 490.962973ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-22T20:27:25.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 553.795098ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302024-11-22T20:27:26.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 729.45376ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2312024-11-22T20:27:27.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.350701717s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2322024-11-22T20:27:28.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 905.435513ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2332024-11-22T20:27:30.256ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.995922331s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2342024-11-22T20:27:30.262ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/nexus.rs:527 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2352024-11-22T20:27:30.292ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2362024-11-22T20:27:30.293ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2372024-11-22T20:27:30.294ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2382024-11-22T20:27:30.294ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2392024-11-22T20:27:30.294ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2402024-11-22T20:27:30.294ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2412024-11-22T20:27:30.294ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/sled-agent-request.json"
2422024-11-22T20:27:30.294ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2432024-11-22T20:27:30.294ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/sled-agent-request.json"
2442024-11-22T20:27:30.294ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2452024-11-22T20:27:30.294ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2462024-11-22T20:27:30.294ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
2472024-11-22T20:27:30.294ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:53433
2482024-11-22T20:27:30.513ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2492024-11-22T20:27:30.513ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2502024-11-22T20:27:30.514ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-22T20:27:30.514ZINFOSledAgent (RSS): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2522024-11-22T20:27:30.514ZINFOSledAgent (RSS): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2532024-11-22T20:27:30.514ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2542024-11-22T20:27:30.514ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-11-22T20:27:30.514ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-22T20:27:30.514ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2572024-11-22T20:27:30.520ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4326 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2582024-11-22T20:27:30.520ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4342
2592024-11-22T20:27:30.520ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2602024-11-22T20:27:30.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62017
2612024-11-22T20:27:30.786ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2622024-11-22T20:27:30.786ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2632024-11-22T20:27:30.786ZINFOSledAgent (ServiceManager): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:189
2642024-11-22T20:27:30.786ZINFOSledAgent (ServiceManager): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:189
2652024-11-22T20:27:30.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62017 req_id = ddd80548-0ba1-4d24-90a6-636e36758de4 response_code = 200 uri = /inventory
2662024-11-22T20:27:30.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33877
2672024-11-22T20:27:30.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33877 req_id = dc1aabdc-94f9-444d-a568-6bc0ef7616d3 response_code = 200 uri = /sled-role
2682024-11-22T20:27:30.818ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2692024-11-22T20:27:30.818ZINFOSledAgent (RSS): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2702024-11-22T20:27:30.819ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/rss-service-plan-v5.json"
2712024-11-22T20:27:30.819ZINFOSledAgent (RSS): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2722024-11-22T20:27:30.819ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/rss-service-plan-v5.json"
2732024-11-22T20:27:30.819ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2742024-11-22T20:27:30.851ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 05510c58-61fa-4a5f-9290-886dc03bee80, pool_id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: dc124740-dffd-4e2f-9308-580587d8ef6d, pool_id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: f9148cb9-d86a-4fc2-84ec-22b4d8e6ab7b, pool_id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 02ff1885-d80b-42de-b17c-5cfed83ff2e5, pool_id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 9456fd79-74c3-43af-a151-865b87cb7967, pool_id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: f7950d01-8d8d-4b63-bc87-a018d0c2fa79, pool_id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: bdd7d305-bc5d-4dc8-aae8-2442a4655f0c, pool_id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 5ed56b9b-531f-428f-91f0-4084fad13893, pool_id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: fe3de36e-028a-4361-8d76-82d634f6ad12, pool_id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2752024-11-22T20:27:30.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59013
2762024-11-22T20:27:30.852ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:883 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2772024-11-22T20:27:30.852ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 05510c58-61fa-4a5f-9290-886dc03bee80, pool_id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: dc124740-dffd-4e2f-9308-580587d8ef6d, pool_id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: f9148cb9-d86a-4fc2-84ec-22b4d8e6ab7b, pool_id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 02ff1885-d80b-42de-b17c-5cfed83ff2e5, pool_id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 9456fd79-74c3-43af-a151-865b87cb7967, pool_id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: f7950d01-8d8d-4b63-bc87-a018d0c2fa79, pool_id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: bdd7d305-bc5d-4dc8-aae8-2442a4655f0c, pool_id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 5ed56b9b-531f-428f-91f0-4084fad13893, pool_id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: fe3de36e-028a-4361-8d76-82d634f6ad12, pool_id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2782024-11-22T20:27:30.852ZINFOSledAgent (StorageManager): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2792024-11-22T20:27:30.852ZINFOSledAgent (StorageManager): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2802024-11-22T20:27:30.852ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1175 request = omicron_physical_disks_ensure
2812024-11-22T20:27:30.852ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2822024-11-22T20:27:30.852ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2832024-11-22T20:27:30.852ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842024-11-22T20:27:30.852ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2852024-11-22T20:27:30.999ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2862024-11-22T20:27:30.999ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool)
2872024-11-22T20:27:31.295ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2882024-11-22T20:27:31.734ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2892024-11-22T20:27:31.734ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2902024-11-22T20:27:32.213ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
2912024-11-22T20:27:32.226ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }
2922024-11-22T20:27:32.235ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2932024-11-22T20:27:32.235ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2942024-11-22T20:27:32.235ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2952024-11-22T20:27:32.235ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2962024-11-22T20:27:32.235ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2972024-11-22T20:27:32.235ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2982024-11-22T20:27:32.235ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2992024-11-22T20:27:32.275ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3002024-11-22T20:27:32.283ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone file = sled-storage/src/dataset.rs:303
3012024-11-22T20:27:32.297ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
3022024-11-22T20:27:32.461ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 file = sled-storage/src/dataset.rs:389
3032024-11-22T20:27:32.469ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
3042024-11-22T20:27:32.469ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
3052024-11-22T20:27:32.469ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
3062024-11-22T20:27:32.469ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3072024-11-22T20:27:32.469ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
3082024-11-22T20:27:32.479ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3092024-11-22T20:27:32.479ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool)
3102024-11-22T20:27:32.577ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }
3112024-11-22T20:27:32.584ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3122024-11-22T20:27:32.585ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3132024-11-22T20:27:32.585ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3142024-11-22T20:27:32.585ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3152024-11-22T20:27:32.585ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3162024-11-22T20:27:32.585ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3172024-11-22T20:27:32.585ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3182024-11-22T20:27:32.620ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3192024-11-22T20:27:32.628ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone file = sled-storage/src/dataset.rs:303
3202024-11-22T20:27:32.809ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8c870c6a-53aa-40e3-8b74-681d946263cd file = sled-storage/src/dataset.rs:389
3212024-11-22T20:27:32.817ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3222024-11-22T20:27:32.817ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3232024-11-22T20:27:32.817ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3242024-11-22T20:27:32.817ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3252024-11-22T20:27:32.817ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3262024-11-22T20:27:32.827ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3272024-11-22T20:27:32.827ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool)
3282024-11-22T20:27:32.920ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }
3292024-11-22T20:27:32.928ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3302024-11-22T20:27:32.928ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3312024-11-22T20:27:32.928ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3322024-11-22T20:27:32.928ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3332024-11-22T20:27:32.928ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3342024-11-22T20:27:32.928ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3352024-11-22T20:27:32.928ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3362024-11-22T20:27:32.964ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3372024-11-22T20:27:32.972ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone file = sled-storage/src/dataset.rs:303
3382024-11-22T20:27:33.141ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26 file = sled-storage/src/dataset.rs:389
3392024-11-22T20:27:33.150ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3402024-11-22T20:27:33.150ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3412024-11-22T20:27:33.150ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3422024-11-22T20:27:33.150ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3432024-11-22T20:27:33.150ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3442024-11-22T20:27:33.160ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3452024-11-22T20:27:33.160ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool)
3462024-11-22T20:27:33.256ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }
3472024-11-22T20:27:33.265ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3482024-11-22T20:27:33.265ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3492024-11-22T20:27:33.265ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3502024-11-22T20:27:33.265ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3512024-11-22T20:27:33.265ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3522024-11-22T20:27:33.265ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3532024-11-22T20:27:33.265ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3542024-11-22T20:27:33.299ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
3552024-11-22T20:27:33.300ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3562024-11-22T20:27:33.309ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/zone file = sled-storage/src/dataset.rs:303
3572024-11-22T20:27:33.488ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e83de9a9-73fc-4157-8f0d-bc628401b262 file = sled-storage/src/dataset.rs:389
3582024-11-22T20:27:33.497ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3592024-11-22T20:27:33.497ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3602024-11-22T20:27:33.497ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3612024-11-22T20:27:33.497ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3622024-11-22T20:27:33.497ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3632024-11-22T20:27:33.507ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3642024-11-22T20:27:33.507ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool)
3652024-11-22T20:27:33.603ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }
3662024-11-22T20:27:33.611ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3672024-11-22T20:27:33.611ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3682024-11-22T20:27:33.611ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3692024-11-22T20:27:33.611ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3702024-11-22T20:27:33.611ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3712024-11-22T20:27:33.611ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3722024-11-22T20:27:33.611ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3732024-11-22T20:27:33.647ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3742024-11-22T20:27:33.656ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/zone file = sled-storage/src/dataset.rs:303
3752024-11-22T20:27:33.829ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6192e0c0-75f6-422c-9444-5c281ce64c40 file = sled-storage/src/dataset.rs:389
3762024-11-22T20:27:33.837ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3772024-11-22T20:27:33.837ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3782024-11-22T20:27:33.837ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3792024-11-22T20:27:33.837ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3802024-11-22T20:27:33.837ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3812024-11-22T20:27:33.847ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3822024-11-22T20:27:33.848ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool)
3832024-11-22T20:27:33.941ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }
3842024-11-22T20:27:33.948ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3852024-11-22T20:27:33.948ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3862024-11-22T20:27:33.948ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3872024-11-22T20:27:33.948ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3882024-11-22T20:27:33.948ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3892024-11-22T20:27:33.949ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3902024-11-22T20:27:33.949ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3912024-11-22T20:27:33.985ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3922024-11-22T20:27:33.993ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_48b30200-6d9c-435a-8546-6c099d7abe31/crypt/zone file = sled-storage/src/dataset.rs:303
3932024-11-22T20:27:34.167ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_48b30200-6d9c-435a-8546-6c099d7abe31 file = sled-storage/src/dataset.rs:389
3942024-11-22T20:27:34.175ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3952024-11-22T20:27:34.175ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3962024-11-22T20:27:34.175ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3972024-11-22T20:27:34.175ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3982024-11-22T20:27:34.175ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3992024-11-22T20:27:34.186ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
4002024-11-22T20:27:34.186ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool)
4012024-11-22T20:27:34.294ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }
4022024-11-22T20:27:34.303ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
4032024-11-22T20:27:34.303ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
4042024-11-22T20:27:34.303ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
4052024-11-22T20:27:34.303ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
4062024-11-22T20:27:34.303ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4072024-11-22T20:27:34.303ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4082024-11-22T20:27:34.303ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4092024-11-22T20:27:34.307ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4102024-11-22T20:27:34.340ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4112024-11-22T20:27:34.351ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1/crypt/zone file = sled-storage/src/dataset.rs:303
4122024-11-22T20:27:34.529ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1 file = sled-storage/src/dataset.rs:389
4132024-11-22T20:27:34.536ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4142024-11-22T20:27:34.536ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4152024-11-22T20:27:34.536ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4162024-11-22T20:27:34.536ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4172024-11-22T20:27:34.536ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4182024-11-22T20:27:34.546ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4192024-11-22T20:27:34.546ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool)
4202024-11-22T20:27:34.647ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }
4212024-11-22T20:27:34.654ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4222024-11-22T20:27:34.654ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4232024-11-22T20:27:34.654ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4242024-11-22T20:27:34.655ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4252024-11-22T20:27:34.655ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4262024-11-22T20:27:34.655ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4272024-11-22T20:27:34.655ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4282024-11-22T20:27:34.689ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4292024-11-22T20:27:34.697ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f/crypt/zone file = sled-storage/src/dataset.rs:303
4302024-11-22T20:27:34.867ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f file = sled-storage/src/dataset.rs:389
4312024-11-22T20:27:34.875ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4322024-11-22T20:27:34.875ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4332024-11-22T20:27:34.875ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4342024-11-22T20:27:34.875ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4352024-11-22T20:27:34.875ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4362024-11-22T20:27:34.885ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4372024-11-22T20:27:34.885ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool)
4382024-11-22T20:27:34.982ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }
4392024-11-22T20:27:34.989ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4402024-11-22T20:27:34.989ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4412024-11-22T20:27:34.989ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4422024-11-22T20:27:34.989ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4432024-11-22T20:27:34.989ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4442024-11-22T20:27:34.990ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4452024-11-22T20:27:34.990ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4462024-11-22T20:27:35.025ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4472024-11-22T20:27:35.033ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_04456916-263d-47e8-84ad-1a50c9bd09d7/crypt/zone file = sled-storage/src/dataset.rs:303
4482024-11-22T20:27:35.213ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_04456916-263d-47e8-84ad-1a50c9bd09d7 file = sled-storage/src/dataset.rs:389
4492024-11-22T20:27:35.222ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4502024-11-22T20:27:35.222ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4512024-11-22T20:27:35.222ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4522024-11-22T20:27:35.222ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5b2602eb-7e15-49ac-949a-e1f7df8df0ca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 058a0e77-cb12-4f9b-aca7-8d6329f3077f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4532024-11-22T20:27:35.222ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4542024-11-22T20:27:35.222ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4552024-11-22T20:27:35.222ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4562024-11-22T20:27:35.222ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4572024-11-22T20:27:35.223ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4582024-11-22T20:27:35.223ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:887 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4592024-11-22T20:27:35.223ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4602024-11-22T20:27:35.223ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:913 generation = Generation(1) sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4612024-11-22T20:27:35.223ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:918 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4622024-11-22T20:27:35.223ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:923 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4632024-11-22T20:27:35.223ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4642024-11-22T20:27:35.223ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:929 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4652024-11-22T20:27:35.223ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4662024-11-22T20:27:35.223ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:934 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4672024-11-22T20:27:35.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4371300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59013 req_id = 5474e005-2ac8-470f-9f13-0f0dfe6a043a response_code = 200 uri = /omicron-physical-disks
4682024-11-22T20:27:35.255ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0092f8b7-325a-41ca-98db-f4ab704f4e3a (dataset): DatasetConfig { id: 0092f8b7-325a-41ca-98db-f4ab704f4e3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03aca110-6940-4179-aaef-8d444f0862dd (dataset): DatasetConfig { id: 03aca110-6940-4179-aaef-8d444f0862dd (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ad4c586-4013-4302-9959-6fcda649d0c6 (dataset): DatasetConfig { id: 0ad4c586-4013-4302-9959-6fcda649d0c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 177315f5-5d49-486b-a509-7ec14e606673 (dataset): DatasetConfig { id: 177315f5-5d49-486b-a509-7ec14e606673 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22c07292-793c-445e-960d-8b28d9662197 (dataset): DatasetConfig { id: 22c07292-793c-445e-960d-8b28d9662197 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 247e4889-3147-4239-9f16-c2957447ba6f (dataset): DatasetConfig { id: 247e4889-3147-4239-9f16-c2957447ba6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27e7ec82-d7ed-49a3-af6f-898dca7dd93f (dataset): DatasetConfig { id: 27e7ec82-d7ed-49a3-af6f-898dca7dd93f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a0a80dc-5e94-41fb-aa13-8b1230d5dbdb (dataset): DatasetConfig { id: 2a0a80dc-5e94-41fb-aa13-8b1230d5dbdb (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 392f3fa0-4fdc-480e-bfeb-8ead0780416c (dataset): DatasetConfig { id: 392f3fa0-4fdc-480e-bfeb-8ead0780416c (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a7e2039-5546-4256-83a6-afe0e7669143 (dataset): DatasetConfig { id: 3a7e2039-5546-4256-83a6-afe0e7669143 (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 425abb74-d583-4d21-a678-176c222d6d2b (dataset): DatasetConfig { id: 425abb74-d583-4d21-a678-176c222d6d2b (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43de9778-e66b-45c6-93aa-40c390beca6f (dataset): DatasetConfig { id: 43de9778-e66b-45c6-93aa-40c390beca6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 442b5026-4e04-472d-9a87-fe711e66ce82 (dataset): DatasetConfig { id: 442b5026-4e04-472d-9a87-fe711e66ce82 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4614143e-de4f-40ed-b3c8-aec9204a3051 (dataset): DatasetConfig { id: 4614143e-de4f-40ed-b3c8-aec9204a3051 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b8302dd-705a-4ec5-b3b0-309b6b6447b8 (dataset): DatasetConfig { id: 4b8302dd-705a-4ec5-b3b0-309b6b6447b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e8e3172-90c2-4899-86af-d0f6ef6251e5 (dataset): DatasetConfig { id: 4e8e3172-90c2-4899-86af-d0f6ef6251e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e966c3b-63b6-46b5-a616-0236ce429b1f (dataset): DatasetConfig { id: 4e966c3b-63b6-46b5-a616-0236ce429b1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50156a54-1a9b-4748-9812-6b8bedf45c52 (dataset): DatasetConfig { id: 50156a54-1a9b-4748-9812-6b8bedf45c52 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51717f17-736b-47a6-a81c-610d818b8cf4 (dataset): DatasetConfig { id: 51717f17-736b-47a6-a81c-610d818b8cf4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 523a0ea3-c18e-4bcc-9a85-28d92daac209 (dataset): DatasetConfig { id: 523a0ea3-c18e-4bcc-9a85-28d92daac209 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58561691-0f23-4045-817d-efd7fc8e0d2e (dataset): DatasetConfig { id: 58561691-0f23-4045-817d-efd7fc8e0d2e (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5aee6be1-defd-4e71-839f-5ae5a4ebd6d9 (dataset): DatasetConfig { id: 5aee6be1-defd-4e71-839f-5ae5a4ebd6d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5eedbb16-9a4e-4be2-b61f-437053d3001b (dataset): DatasetConfig { id: 5eedbb16-9a4e-4be2-b61f-437053d3001b (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6097601f-f318-461d-96c1-9b681047d915 (dataset): DatasetConfig { id: 6097601f-f318-461d-96c1-9b681047d915 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66bc5405-ffea-4a1e-b10d-0c31390c168c (dataset): DatasetConfig { id: 66bc5405-ffea-4a1e-b10d-0c31390c168c (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c94419c-4b72-4692-95f0-7b29b75c83ab (dataset): DatasetConfig { id: 6c94419c-4b72-4692-95f0-7b29b75c83ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d06e726-9392-4950-8b81-6ebd1e4fdfad (dataset): DatasetConfig { id: 6d06e726-9392-4950-8b81-6ebd1e4fdfad (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e09f761-9809-4475-8d0b-6ea7015be044 (dataset): DatasetConfig { id: 6e09f761-9809-4475-8d0b-6ea7015be044 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 70d10047-527c-4902-a183-f982b1f29778 (dataset): DatasetConfig { id: 70d10047-527c-4902-a183-f982b1f29778 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72dc0bed-39dc-4954-a7d0-b714e2d6ad5c (dataset): DatasetConfig { id: 72dc0bed-39dc-4954-a7d0-b714e2d6ad5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77e59976-13f7-45d1-a427-2f25c30da160 (dataset): DatasetConfig { id: 77e59976-13f7-45d1-a427-2f25c30da160 (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a98369a-9177-4957-a1d4-96ec80e42e87 (dataset): DatasetConfig { id: 7a98369a-9177-4957-a1d4-96ec80e42e87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d899f43-fa89-493b-bae0-da8f236acab2 (dataset): DatasetConfig { id: 7d899f43-fa89-493b-bae0-da8f236acab2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b893c90-d6f6-4c3b-817d-faba1555c659 (dataset): DatasetConfig { id: 8b893c90-d6f6-4c3b-817d-faba1555c659 (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c191bff-78d0-4023-80d8-dd2ec6af7af8 (dataset): DatasetConfig { id: 8c191bff-78d0-4023-80d8-dd2ec6af7af8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e21b2c9-a463-48d8-9019-358dc6e8dbb8 (dataset): DatasetConfig { id: 8e21b2c9-a463-48d8-9019-358dc6e8dbb8 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fdd20a4-6008-42bf-bc84-2dab1de9a892 (dataset): DatasetConfig { id: 8fdd20a4-6008-42bf-bc84-2dab1de9a892 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91a6901e-002b-459c-83c9-c46c2f54e785 (dataset): DatasetConfig { id: 91a6901e-002b-459c-83c9-c46c2f54e785 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 978b0ead-8a1b-4a24-a860-45c50f54f504 (dataset): DatasetConfig { id: 978b0ead-8a1b-4a24-a860-45c50f54f504 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b774cc3-7535-4fcc-973c-9f3421c14167 (dataset): DatasetConfig { id: 9b774cc3-7535-4fcc-973c-9f3421c14167 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9b94405c-2892-4ee4-9034-5a1c2b979842 (dataset): DatasetConfig { id: 9b94405c-2892-4ee4-9034-5a1c2b979842 (dataset), name: DatasetName { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c00b510-07b0-4b2c-97bb-ade3c279ca00 (dataset): DatasetConfig { id: 9c00b510-07b0-4b2c-97bb-ade3c279ca00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9daa2e03-1e48-453b-9a6c-014a31340c7f (dataset): DatasetConfig { id: 9daa2e03-1e48-453b-9a6c-014a31340c7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f29ff40-018e-4fbf-94e9-d1b2d28418f3 (dataset): DatasetConfig { id: 9f29ff40-018e-4fbf-94e9-d1b2d28418f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a2572e17-eb39-443f-a1e2-4a4d2c907f5f (dataset): DatasetConfig { id: a2572e17-eb39-443f-a1e2-4a4d2c907f5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3ad35a0-f405-4ee2-9c5d-98b3e0396a79 (dataset): DatasetConfig { id: a3ad35a0-f405-4ee2-9c5d-98b3e0396a79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ac9b56bd-b22b-4045-a5fe-1a486283b930 (dataset): DatasetConfig { id: ac9b56bd-b22b-4045-a5fe-1a486283b930 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b85c3367-e461-4a55-8c11-7f1317e8fc7a (dataset): DatasetConfig { id: b85c3367-e461-4a55-8c11-7f1317e8fc7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bfdbc273-917e-43ec-a766-fab6df285fb2 (dataset): DatasetConfig { id: bfdbc273-917e-43ec-a766-fab6df285fb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c169b048-abb9-476f-a5e6-fab3f4529b34 (dataset): DatasetConfig { id: c169b048-abb9-476f-a5e6-fab3f4529b34 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c3a2b384-524a-478a-b836-cfb85da916a1 (dataset): DatasetConfig { id: c3a2b384-524a-478a-b836-cfb85da916a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc424bfb-8202-4480-9cf8-e9f0fd693adb (dataset): DatasetConfig { id: cc424bfb-8202-4480-9cf8-e9f0fd693adb (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ccc58edd-4969-4fd1-b232-e48f2f35aa41 (dataset): DatasetConfig { id: ccc58edd-4969-4fd1-b232-e48f2f35aa41 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf09f492-424c-4452-b39e-9c15af1ff65d (dataset): DatasetConfig { id: cf09f492-424c-4452-b39e-9c15af1ff65d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d059e741-6fa6-467c-8dd6-81b121d5ec8e (dataset): DatasetConfig { id: d059e741-6fa6-467c-8dd6-81b121d5ec8e (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d343d599-53e7-4409-bcd6-a74972fac8d3 (dataset): DatasetConfig { id: d343d599-53e7-4409-bcd6-a74972fac8d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d69ee87f-0c0a-4cbc-802c-3b1b1af52728 (dataset): DatasetConfig { id: d69ee87f-0c0a-4cbc-802c-3b1b1af52728 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7594f63-82ea-4493-ba3d-5e28459db20f (dataset): DatasetConfig { id: d7594f63-82ea-4493-ba3d-5e28459db20f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8c7bfed-5f56-4848-83f5-0ad1c3483d38 (dataset): DatasetConfig { id: d8c7bfed-5f56-4848-83f5-0ad1c3483d38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc96de5c-8b52-4528-be7f-09392df674cb (dataset): DatasetConfig { id: dc96de5c-8b52-4528-be7f-09392df674cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, deb4e2f2-318d-4347-a057-3ea02a966d12 (dataset): DatasetConfig { id: deb4e2f2-318d-4347-a057-3ea02a966d12 (dataset), name: DatasetName { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7a0fc20-6f3e-47f1-811b-791a15d9fd50 (dataset): DatasetConfig { id: e7a0fc20-6f3e-47f1-811b-791a15d9fd50 (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eea7bc18-779b-40f9-a828-8cfee5a237d0 (dataset): DatasetConfig { id: eea7bc18-779b-40f9-a828-8cfee5a237d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f009090b-7457-4a7e-9c99-a71f20fed64d (dataset): DatasetConfig { id: f009090b-7457-4a7e-9c99-a71f20fed64d (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7f5083c-98f1-4ebc-9872-dcc0596c500f (dataset): DatasetConfig { id: f7f5083c-98f1-4ebc-9872-dcc0596c500f (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, faa7ff11-8fc5-4c48-8a8c-1dc5271c4b0b (dataset): DatasetConfig { id: faa7ff11-8fc5-4c48-8a8c-1dc5271c4b0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4692024-11-22T20:27:35.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60493
4702024-11-22T20:27:35.255ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:849 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4712024-11-22T20:27:35.256ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0092f8b7-325a-41ca-98db-f4ab704f4e3a (dataset): DatasetConfig { id: 0092f8b7-325a-41ca-98db-f4ab704f4e3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03aca110-6940-4179-aaef-8d444f0862dd (dataset): DatasetConfig { id: 03aca110-6940-4179-aaef-8d444f0862dd (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ad4c586-4013-4302-9959-6fcda649d0c6 (dataset): DatasetConfig { id: 0ad4c586-4013-4302-9959-6fcda649d0c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 177315f5-5d49-486b-a509-7ec14e606673 (dataset): DatasetConfig { id: 177315f5-5d49-486b-a509-7ec14e606673 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22c07292-793c-445e-960d-8b28d9662197 (dataset): DatasetConfig { id: 22c07292-793c-445e-960d-8b28d9662197 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 247e4889-3147-4239-9f16-c2957447ba6f (dataset): DatasetConfig { id: 247e4889-3147-4239-9f16-c2957447ba6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27e7ec82-d7ed-49a3-af6f-898dca7dd93f (dataset): DatasetConfig { id: 27e7ec82-d7ed-49a3-af6f-898dca7dd93f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a0a80dc-5e94-41fb-aa13-8b1230d5dbdb (dataset): DatasetConfig { id: 2a0a80dc-5e94-41fb-aa13-8b1230d5dbdb (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 392f3fa0-4fdc-480e-bfeb-8ead0780416c (dataset): DatasetConfig { id: 392f3fa0-4fdc-480e-bfeb-8ead0780416c (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a7e2039-5546-4256-83a6-afe0e7669143 (dataset): DatasetConfig { id: 3a7e2039-5546-4256-83a6-afe0e7669143 (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 425abb74-d583-4d21-a678-176c222d6d2b (dataset): DatasetConfig { id: 425abb74-d583-4d21-a678-176c222d6d2b (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43de9778-e66b-45c6-93aa-40c390beca6f (dataset): DatasetConfig { id: 43de9778-e66b-45c6-93aa-40c390beca6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 442b5026-4e04-472d-9a87-fe711e66ce82 (dataset): DatasetConfig { id: 442b5026-4e04-472d-9a87-fe711e66ce82 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4614143e-de4f-40ed-b3c8-aec9204a3051 (dataset): DatasetConfig { id: 4614143e-de4f-40ed-b3c8-aec9204a3051 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b8302dd-705a-4ec5-b3b0-309b6b6447b8 (dataset): DatasetConfig { id: 4b8302dd-705a-4ec5-b3b0-309b6b6447b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e8e3172-90c2-4899-86af-d0f6ef6251e5 (dataset): DatasetConfig { id: 4e8e3172-90c2-4899-86af-d0f6ef6251e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e966c3b-63b6-46b5-a616-0236ce429b1f (dataset): DatasetConfig { id: 4e966c3b-63b6-46b5-a616-0236ce429b1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50156a54-1a9b-4748-9812-6b8bedf45c52 (dataset): DatasetConfig { id: 50156a54-1a9b-4748-9812-6b8bedf45c52 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51717f17-736b-47a6-a81c-610d818b8cf4 (dataset): DatasetConfig { id: 51717f17-736b-47a6-a81c-610d818b8cf4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 523a0ea3-c18e-4bcc-9a85-28d92daac209 (dataset): DatasetConfig { id: 523a0ea3-c18e-4bcc-9a85-28d92daac209 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58561691-0f23-4045-817d-efd7fc8e0d2e (dataset): DatasetConfig { id: 58561691-0f23-4045-817d-efd7fc8e0d2e (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5aee6be1-defd-4e71-839f-5ae5a4ebd6d9 (dataset): DatasetConfig { id: 5aee6be1-defd-4e71-839f-5ae5a4ebd6d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5eedbb16-9a4e-4be2-b61f-437053d3001b (dataset): DatasetConfig { id: 5eedbb16-9a4e-4be2-b61f-437053d3001b (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6097601f-f318-461d-96c1-9b681047d915 (dataset): DatasetConfig { id: 6097601f-f318-461d-96c1-9b681047d915 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66bc5405-ffea-4a1e-b10d-0c31390c168c (dataset): DatasetConfig { id: 66bc5405-ffea-4a1e-b10d-0c31390c168c (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c94419c-4b72-4692-95f0-7b29b75c83ab (dataset): DatasetConfig { id: 6c94419c-4b72-4692-95f0-7b29b75c83ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d06e726-9392-4950-8b81-6ebd1e4fdfad (dataset): DatasetConfig { id: 6d06e726-9392-4950-8b81-6ebd1e4fdfad (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e09f761-9809-4475-8d0b-6ea7015be044 (dataset): DatasetConfig { id: 6e09f761-9809-4475-8d0b-6ea7015be044 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 70d10047-527c-4902-a183-f982b1f29778 (dataset): DatasetConfig { id: 70d10047-527c-4902-a183-f982b1f29778 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72dc0bed-39dc-4954-a7d0-b714e2d6ad5c (dataset): DatasetConfig { id: 72dc0bed-39dc-4954-a7d0-b714e2d6ad5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77e59976-13f7-45d1-a427-2f25c30da160 (dataset): DatasetConfig { id: 77e59976-13f7-45d1-a427-2f25c30da160 (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a98369a-9177-4957-a1d4-96ec80e42e87 (dataset): DatasetConfig { id: 7a98369a-9177-4957-a1d4-96ec80e42e87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d899f43-fa89-493b-bae0-da8f236acab2 (dataset): DatasetConfig { id: 7d899f43-fa89-493b-bae0-da8f236acab2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b893c90-d6f6-4c3b-817d-faba1555c659 (dataset): DatasetConfig { id: 8b893c90-d6f6-4c3b-817d-faba1555c659 (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c191bff-78d0-4023-80d8-dd2ec6af7af8 (dataset): DatasetConfig { id: 8c191bff-78d0-4023-80d8-dd2ec6af7af8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e21b2c9-a463-48d8-9019-358dc6e8dbb8 (dataset): DatasetConfig { id: 8e21b2c9-a463-48d8-9019-358dc6e8dbb8 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fdd20a4-6008-42bf-bc84-2dab1de9a892 (dataset): DatasetConfig { id: 8fdd20a4-6008-42bf-bc84-2dab1de9a892 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91a6901e-002b-459c-83c9-c46c2f54e785 (dataset): DatasetConfig { id: 91a6901e-002b-459c-83c9-c46c2f54e785 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 978b0ead-8a1b-4a24-a860-45c50f54f504 (dataset): DatasetConfig { id: 978b0ead-8a1b-4a24-a860-45c50f54f504 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b774cc3-7535-4fcc-973c-9f3421c14167 (dataset): DatasetConfig { id: 9b774cc3-7535-4fcc-973c-9f3421c14167 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9b94405c-2892-4ee4-9034-5a1c2b979842 (dataset): DatasetConfig { id: 9b94405c-2892-4ee4-9034-5a1c2b979842 (dataset), name: DatasetName { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c00b510-07b0-4b2c-97bb-ade3c279ca00 (dataset): DatasetConfig { id: 9c00b510-07b0-4b2c-97bb-ade3c279ca00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9daa2e03-1e48-453b-9a6c-014a31340c7f (dataset): DatasetConfig { id: 9daa2e03-1e48-453b-9a6c-014a31340c7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f29ff40-018e-4fbf-94e9-d1b2d28418f3 (dataset): DatasetConfig { id: 9f29ff40-018e-4fbf-94e9-d1b2d28418f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a2572e17-eb39-443f-a1e2-4a4d2c907f5f (dataset): DatasetConfig { id: a2572e17-eb39-443f-a1e2-4a4d2c907f5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3ad35a0-f405-4ee2-9c5d-98b3e0396a79 (dataset): DatasetConfig { id: a3ad35a0-f405-4ee2-9c5d-98b3e0396a79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ac9b56bd-b22b-4045-a5fe-1a486283b930 (dataset): DatasetConfig { id: ac9b56bd-b22b-4045-a5fe-1a486283b930 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b85c3367-e461-4a55-8c11-7f1317e8fc7a (dataset): DatasetConfig { id: b85c3367-e461-4a55-8c11-7f1317e8fc7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bfdbc273-917e-43ec-a766-fab6df285fb2 (dataset): DatasetConfig { id: bfdbc273-917e-43ec-a766-fab6df285fb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c169b048-abb9-476f-a5e6-fab3f4529b34 (dataset): DatasetConfig { id: c169b048-abb9-476f-a5e6-fab3f4529b34 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c3a2b384-524a-478a-b836-cfb85da916a1 (dataset): DatasetConfig { id: c3a2b384-524a-478a-b836-cfb85da916a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc424bfb-8202-4480-9cf8-e9f0fd693adb (dataset): DatasetConfig { id: cc424bfb-8202-4480-9cf8-e9f0fd693adb (dataset), name: DatasetName { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ccc58edd-4969-4fd1-b232-e48f2f35aa41 (dataset): DatasetConfig { id: ccc58edd-4969-4fd1-b232-e48f2f35aa41 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf09f492-424c-4452-b39e-9c15af1ff65d (dataset): DatasetConfig { id: cf09f492-424c-4452-b39e-9c15af1ff65d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d059e741-6fa6-467c-8dd6-81b121d5ec8e (dataset): DatasetConfig { id: d059e741-6fa6-467c-8dd6-81b121d5ec8e (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d343d599-53e7-4409-bcd6-a74972fac8d3 (dataset): DatasetConfig { id: d343d599-53e7-4409-bcd6-a74972fac8d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d69ee87f-0c0a-4cbc-802c-3b1b1af52728 (dataset): DatasetConfig { id: d69ee87f-0c0a-4cbc-802c-3b1b1af52728 (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7594f63-82ea-4493-ba3d-5e28459db20f (dataset): DatasetConfig { id: d7594f63-82ea-4493-ba3d-5e28459db20f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8c7bfed-5f56-4848-83f5-0ad1c3483d38 (dataset): DatasetConfig { id: d8c7bfed-5f56-4848-83f5-0ad1c3483d38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc96de5c-8b52-4528-be7f-09392df674cb (dataset): DatasetConfig { id: dc96de5c-8b52-4528-be7f-09392df674cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, deb4e2f2-318d-4347-a057-3ea02a966d12 (dataset): DatasetConfig { id: deb4e2f2-318d-4347-a057-3ea02a966d12 (dataset), name: DatasetName { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7a0fc20-6f3e-47f1-811b-791a15d9fd50 (dataset): DatasetConfig { id: e7a0fc20-6f3e-47f1-811b-791a15d9fd50 (dataset), name: DatasetName { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eea7bc18-779b-40f9-a828-8cfee5a237d0 (dataset): DatasetConfig { id: eea7bc18-779b-40f9-a828-8cfee5a237d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f009090b-7457-4a7e-9c99-a71f20fed64d (dataset): DatasetConfig { id: f009090b-7457-4a7e-9c99-a71f20fed64d (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7f5083c-98f1-4ebc-9872-dcc0596c500f (dataset): DatasetConfig { id: f7f5083c-98f1-4ebc-9872-dcc0596c500f (dataset), name: DatasetName { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, faa7ff11-8fc5-4c48-8a8c-1dc5271c4b0b (dataset): DatasetConfig { id: faa7ff11-8fc5-4c48-8a8c-1dc5271c4b0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4722024-11-22T20:27:35.256ZINFOSledAgent (StorageManager): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4732024-11-22T20:27:35.256ZINFOSledAgent (StorageManager): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4742024-11-22T20:27:35.256ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:906 request = datasets_ensure
4752024-11-22T20:27:35.256ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4762024-11-22T20:27:35.256ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone/oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone/oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66" } file = sled-storage/src/manager.rs:1338
4772024-11-22T20:27:35.309ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4782024-11-22T20:27:35.360ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4792024-11-22T20:27:35.360ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crucible" } file = sled-storage/src/manager.rs:1338
4802024-11-22T20:27:35.450ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4812024-11-22T20:27:35.450ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone/oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5"), full_name: "oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone/oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5" } file = sled-storage/src/manager.rs:1338
4822024-11-22T20:27:35.556ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4832024-11-22T20:27:35.556ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
4842024-11-22T20:27:35.647ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4852024-11-22T20:27:35.647ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c" } file = sled-storage/src/manager.rs:1338
4862024-11-22T20:27:35.748ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4872024-11-22T20:27:35.748ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d5f676e-00d2-41d0-bdef-829708d70ca1/crypt/zone/oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5"), full_name: "oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1/crypt/zone/oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5" } file = sled-storage/src/manager.rs:1338
4882024-11-22T20:27:35.849ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4892024-11-22T20:27:35.849ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone/oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone/oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85" } file = sled-storage/src/manager.rs:1338
4902024-11-22T20:27:35.949ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4912024-11-22T20:27:35.949ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone"), full_name: "oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone" } file = sled-storage/src/manager.rs:1338
4922024-11-22T20:27:36.019ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4932024-11-22T20:27:36.019ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48b30200-6d9c-435a-8546-6c099d7abe31/crypt/zone/oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90"), full_name: "oxp_48b30200-6d9c-435a-8546-6c099d7abe31/crypt/zone/oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90" } file = sled-storage/src/manager.rs:1338
4942024-11-22T20:27:36.119ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4952024-11-22T20:27:36.119ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/zone"), full_name: "oxp_e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/zone" } file = sled-storage/src/manager.rs:1338
4962024-11-22T20:27:36.189ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4972024-11-22T20:27:36.189ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/zone/oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf"), full_name: "oxp_e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/zone/oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf" } file = sled-storage/src/manager.rs:1338
4982024-11-22T20:27:36.256ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 12.098386838s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
4992024-11-22T20:27:36.289ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5002024-11-22T20:27:36.289ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/04456916-263d-47e8-84ad-1a50c9bd09d7/crypt/zone/oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464"), full_name: "oxp_04456916-263d-47e8-84ad-1a50c9bd09d7/crypt/zone/oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464" } file = sled-storage/src/manager.rs:1338
5012024-11-22T20:27:36.310ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
5022024-11-22T20:27:36.385ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5032024-11-22T20:27:36.385ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48b30200-6d9c-435a-8546-6c099d7abe31/crypt/zone/oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32"), full_name: "oxp_48b30200-6d9c-435a-8546-6c099d7abe31/crypt/zone/oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32" } file = sled-storage/src/manager.rs:1338
5042024-11-22T20:27:36.486ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5052024-11-22T20:27:36.486ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone/oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77"), full_name: "oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone/oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77" } file = sled-storage/src/manager.rs:1338
5062024-11-22T20:27:36.585ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5072024-11-22T20:27:36.585ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/04456916-263d-47e8-84ad-1a50c9bd09d7/crypt/zone"), full_name: "oxp_04456916-263d-47e8-84ad-1a50c9bd09d7/crypt/zone" } file = sled-storage/src/manager.rs:1338
5082024-11-22T20:27:36.652ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5092024-11-22T20:27:36.653ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/09d9b394-0398-412b-87f1-761ce2ca9d9f/crypt/zone/oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693"), full_name: "oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f/crypt/zone/oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693" } file = sled-storage/src/manager.rs:1338
5102024-11-22T20:27:36.752ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5112024-11-22T20:27:36.752ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5122024-11-22T20:27:36.838ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5132024-11-22T20:27:36.838ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83" } file = sled-storage/src/manager.rs:1338
5142024-11-22T20:27:36.939ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5152024-11-22T20:27:36.939ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/zone/oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a"), full_name: "oxp_6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/zone/oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a" } file = sled-storage/src/manager.rs:1338
5162024-11-22T20:27:37.038ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5172024-11-22T20:27:37.038ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73" } file = sled-storage/src/manager.rs:1338
5182024-11-22T20:27:37.137ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5192024-11-22T20:27:37.137ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone/oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d"), full_name: "oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone/oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d" } file = sled-storage/src/manager.rs:1338
5202024-11-22T20:27:37.233ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5212024-11-22T20:27:37.233ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829" } file = sled-storage/src/manager.rs:1338
5222024-11-22T20:27:37.313ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
5232024-11-22T20:27:37.332ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5242024-11-22T20:27:37.332ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/debug"), full_name: "oxp_e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/debug" } file = sled-storage/src/manager.rs:1338
5252024-11-22T20:27:37.401ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5262024-11-22T20:27:37.401ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/zone/oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1"), full_name: "oxp_6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/zone/oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1" } file = sled-storage/src/manager.rs:1338
5272024-11-22T20:27:37.504ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5282024-11-22T20:27:37.505ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5292024-11-22T20:27:37.595ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5302024-11-22T20:27:37.595ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_04456916-263d-47e8-84ad-1a50c9bd09d7/crucible" } file = sled-storage/src/manager.rs:1338
5312024-11-22T20:27:37.682ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5322024-11-22T20:27:37.682ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/zone"), full_name: "oxp_6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/zone" } file = sled-storage/src/manager.rs:1338
5332024-11-22T20:27:37.750ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5342024-11-22T20:27:37.751ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/debug"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/debug" } file = sled-storage/src/manager.rs:1338
5352024-11-22T20:27:37.819ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5362024-11-22T20:27:37.819ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone/oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone/oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793" } file = sled-storage/src/manager.rs:1338
5372024-11-22T20:27:37.923ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5382024-11-22T20:27:37.923ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1/crucible" } file = sled-storage/src/manager.rs:1338
5392024-11-22T20:27:38.012ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5402024-11-22T20:27:38.012ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5412024-11-22T20:27:38.102ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5422024-11-22T20:27:38.102ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48b30200-6d9c-435a-8546-6c099d7abe31/crypt/zone"), full_name: "oxp_48b30200-6d9c-435a-8546-6c099d7abe31/crypt/zone" } file = sled-storage/src/manager.rs:1338
5432024-11-22T20:27:38.173ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5442024-11-22T20:27:38.173ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5452024-11-22T20:27:38.263ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5462024-11-22T20:27:38.263ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/zone/oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0"), full_name: "oxp_e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/zone/oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0" } file = sled-storage/src/manager.rs:1338
5472024-11-22T20:27:38.315ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
5482024-11-22T20:27:38.369ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5492024-11-22T20:27:38.369ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crucible" } file = sled-storage/src/manager.rs:1338
5502024-11-22T20:27:38.461ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5512024-11-22T20:27:38.462ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5522024-11-22T20:27:38.552ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5532024-11-22T20:27:38.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone" } file = sled-storage/src/manager.rs:1338
5542024-11-22T20:27:38.622ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5552024-11-22T20:27:38.622ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647" } file = sled-storage/src/manager.rs:1338
5562024-11-22T20:27:38.723ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5572024-11-22T20:27:38.723ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/zone/oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37" } file = sled-storage/src/manager.rs:1338
5582024-11-22T20:27:38.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5592024-11-22T20:27:38.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/debug"), full_name: "oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/debug" } file = sled-storage/src/manager.rs:1338
5602024-11-22T20:27:38.897ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5612024-11-22T20:27:38.897ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/09d9b394-0398-412b-87f1-761ce2ca9d9f/crypt/zone"), full_name: "oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f/crypt/zone" } file = sled-storage/src/manager.rs:1338
5622024-11-22T20:27:38.967ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5632024-11-22T20:27:38.967ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/09d9b394-0398-412b-87f1-761ce2ca9d9f/crypt/debug"), full_name: "oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f/crypt/debug" } file = sled-storage/src/manager.rs:1338
5642024-11-22T20:27:39.039ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5652024-11-22T20:27:39.039ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone/oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone/oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d" } file = sled-storage/src/manager.rs:1338
5662024-11-22T20:27:39.143ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5672024-11-22T20:27:39.143ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/04456916-263d-47e8-84ad-1a50c9bd09d7/crypt/debug"), full_name: "oxp_04456916-263d-47e8-84ad-1a50c9bd09d7/crypt/debug" } file = sled-storage/src/manager.rs:1338
5682024-11-22T20:27:39.213ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5692024-11-22T20:27:39.213ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5702024-11-22T20:27:39.317ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
5712024-11-22T20:27:39.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5722024-11-22T20:27:39.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48b30200-6d9c-435a-8546-6c099d7abe31/crypt/debug"), full_name: "oxp_48b30200-6d9c-435a-8546-6c099d7abe31/crypt/debug" } file = sled-storage/src/manager.rs:1338
5732024-11-22T20:27:39.398ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5742024-11-22T20:27:39.398ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6192e0c0-75f6-422c-9444-5c281ce64c40/crucible" } file = sled-storage/src/manager.rs:1338
5752024-11-22T20:27:39.488ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5762024-11-22T20:27:39.488ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone" } file = sled-storage/src/manager.rs:1338
5772024-11-22T20:27:39.560ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5782024-11-22T20:27:39.560ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/zone/oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57"), full_name: "oxp_e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/zone/oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57" } file = sled-storage/src/manager.rs:1338
5792024-11-22T20:27:39.663ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5802024-11-22T20:27:39.663ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/debug"), full_name: "oxp_6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/debug" } file = sled-storage/src/manager.rs:1338
5812024-11-22T20:27:39.733ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5822024-11-22T20:27:39.734ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/clickhouse" } file = sled-storage/src/manager.rs:1338
5832024-11-22T20:27:39.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5842024-11-22T20:27:39.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5852024-11-22T20:27:39.920ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5862024-11-22T20:27:39.920ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone/oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/zone/oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4" } file = sled-storage/src/manager.rs:1338
5872024-11-22T20:27:40.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5882024-11-22T20:27:40.023ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/debug"), full_name: "oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/debug" } file = sled-storage/src/manager.rs:1338
5892024-11-22T20:27:40.093ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5902024-11-22T20:27:40.093ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5912024-11-22T20:27:40.184ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5922024-11-22T20:27:40.184ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crucible" } file = sled-storage/src/manager.rs:1338
5932024-11-22T20:27:40.266ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13074069519075209557 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
5942024-11-22T20:27:40.266ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1820273298759935205 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
5952024-11-22T20:27:40.276ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5962024-11-22T20:27:40.276ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone/oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f"), full_name: "oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone/oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f" } file = sled-storage/src/manager.rs:1338
5972024-11-22T20:27:40.320ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
5982024-11-22T20:27:40.385ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5992024-11-22T20:27:40.385ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d5f676e-00d2-41d0-bdef-829708d70ca1/crypt/zone/oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec"), full_name: "oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1/crypt/zone/oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec" } file = sled-storage/src/manager.rs:1338
6002024-11-22T20:27:40.486ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6012024-11-22T20:27:40.486ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
6022024-11-22T20:27:40.577ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6032024-11-22T20:27:40.577ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d5f676e-00d2-41d0-bdef-829708d70ca1/crypt/zone"), full_name: "oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1/crypt/zone" } file = sled-storage/src/manager.rs:1338
6042024-11-22T20:27:40.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6052024-11-22T20:27:40.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f/crucible" } file = sled-storage/src/manager.rs:1338
6062024-11-22T20:27:40.732ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6072024-11-22T20:27:40.732ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e83de9a9-73fc-4157-8f0d-bc628401b262/crucible" } file = sled-storage/src/manager.rs:1338
6082024-11-22T20:27:40.772ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4350
6092024-11-22T20:27:40.772ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4360 gateway = fd00:1122:3344:101::1
6102024-11-22T20:27:40.780ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4374 gateway = fd00:1122:3344:101::1
6112024-11-22T20:27:40.780ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4439
6122024-11-22T20:27:40.832ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6132024-11-22T20:27:40.832ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/09d9b394-0398-412b-87f1-761ce2ca9d9f/crypt/zone/oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b"), full_name: "oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f/crypt/zone/oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b" } file = sled-storage/src/manager.rs:1338
6142024-11-22T20:27:40.947ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4505
6152024-11-22T20:27:40.947ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4532
6162024-11-22T20:27:40.948ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6172024-11-22T20:27:40.949ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_48b30200-6d9c-435a-8546-6c099d7abe31/crucible" } file = sled-storage/src/manager.rs:1338
6182024-11-22T20:27:40.989ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4545
6192024-11-22T20:27:40.989ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4391
6202024-11-22T20:27:41.042ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4433
6212024-11-22T20:27:41.042ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4512 rack_subnet = fd00:1122:3344::
6222024-11-22T20:27:41.055ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6232024-11-22T20:27:41.056ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone/oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817"), full_name: "oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/zone/oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817" } file = sled-storage/src/manager.rs:1338
6242024-11-22T20:27:41.063ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4523
6252024-11-22T20:27:41.063ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4565
6262024-11-22T20:27:41.141ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4597
6272024-11-22T20:27:41.141ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4603
6282024-11-22T20:27:41.172ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6292024-11-22T20:27:41.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d5f676e-00d2-41d0-bdef-829708d70ca1/crypt/debug"), full_name: "oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1/crypt/debug" } file = sled-storage/src/manager.rs:1338
6302024-11-22T20:27:41.238ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4644
6312024-11-22T20:27:41.238ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6322024-11-22T20:27:41.250ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6332024-11-22T20:27:41.251ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-datasets.json" request = datasets_ensure
6342024-11-22T20:27:41.251ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6352024-11-22T20:27:41.251ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-datasets.json" request = datasets_ensure
6362024-11-22T20:27:41.251ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:851 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
6372024-11-22T20:27:41.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5996212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60493 req_id = c1700549-6992-4e47-94bc-fe287641fe21 response_code = 200 uri = /datasets
6382024-11-22T20:27:41.292ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6392024-11-22T20:27:41.292ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/nexus.rs:527 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
6402024-11-22T20:27:41.322ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
6412024-11-22T20:27:41.342ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 635ad13c-159b-401b-8372-a3dc22e52a83 (service), filesystem_pool: Some(ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d (service), filesystem_pool: Some(ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2655aee7-1b4c-458e-bde8-4baa21483b3d (service), filesystem_pool: Some(ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6422024-11-22T20:27:41.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55002
6432024-11-22T20:27:41.343ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6442024-11-22T20:27:41.343ZINFOSledAgent (ServiceManager): No ledger in /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:189
6452024-11-22T20:27:41.343ZINFOSledAgent (ServiceManager): No ledger in /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:189
6462024-11-22T20:27:41.343ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
6472024-11-22T20:27:41.343ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6482024-11-22T20:27:41.343ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6492024-11-22T20:27:41.343ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
6502024-11-22T20:27:41.343ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6512024-11-22T20:27:41.378ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6522024-11-22T20:27:41.378ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6532024-11-22T20:27:41.381ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6542024-11-22T20:27:41.381ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6552024-11-22T20:27:41.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6562024-11-22T20:27:41.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6572024-11-22T20:27:41.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6582024-11-22T20:27:41.445ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d file = illumos-utils/src/zone.rs:325
6592024-11-22T20:27:41.449ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83 file = illumos-utils/src/zone.rs:325
6602024-11-22T20:27:41.454ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d file = illumos-utils/src/zone.rs:325
6612024-11-22T20:27:41.457ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
6622024-11-22T20:27:41.465ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d file = illumos-utils/src/zone.rs:363
6632024-11-22T20:27:41.472ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83 file = illumos-utils/src/zone.rs:363
6642024-11-22T20:27:41.477ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d file = illumos-utils/src/zone.rs:363
6652024-11-22T20:27:41.511ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6662024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6672024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6682024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6692024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6702024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6712024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6722024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6732024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6742024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6752024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6762024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6772024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6782024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6792024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6802024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6812024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6822024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6832024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6842024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6852024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6862024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6872024-11-22T20:27:41.512ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6882024-11-22T20:27:41.736ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
6892024-11-22T20:27:41.737ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
6902024-11-22T20:27:42.324ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
6912024-11-22T20:27:43.129ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6922024-11-22T20:27:43.129ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6932024-11-22T20:27:43.130ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
6942024-11-22T20:27:43.614ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6952024-11-22T20:27:44.094ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6962024-11-22T20:27:44.094ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6972024-11-22T20:27:44.094ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6982024-11-22T20:27:44.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d") failed: Property not found. retry in 46.961007ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
6992024-11-22T20:27:44.103ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7002024-11-22T20:27:44.107ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7012024-11-22T20:27:44.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d") failed: Property not found. retry in 135.690824ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
7022024-11-22T20:27:44.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 30.340952ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7032024-11-22T20:27:44.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83") failed: Property not found. retry in 48.15835ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7042024-11-22T20:27:44.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 89.065667ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7052024-11-22T20:27:44.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83") failed: Property not found. retry in 111.035606ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7062024-11-22T20:27:44.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d") failed: Property not found. retry in 206.686623ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
7072024-11-22T20:27:44.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 264.11838ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7082024-11-22T20:27:44.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83") failed: Property not found. retry in 100.570004ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7092024-11-22T20:27:44.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d") failed: Property not found. retry in 284.17386ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
7102024-11-22T20:27:44.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83") failed: Property not found. retry in 239.522442ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7112024-11-22T20:27:44.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 396.436763ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7122024-11-22T20:27:44.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d") failed: Property not found. retry in 843.522943ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
7132024-11-22T20:27:44.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83") failed: Property not found. retry in 1.156177124s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7142024-11-22T20:27:45.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 654.52323ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7152024-11-22T20:27:45.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d") failed: Property not found. retry in 933.533875ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
7162024-11-22T20:27:45.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 516.55733ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7172024-11-22T20:27:46.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83") failed: Property not found. retry in 1.367033032s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7182024-11-22T20:27:46.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 837.60545ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7192024-11-22T20:27:46.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d") failed: Property not found. retry in 793.37418ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
7202024-11-22T20:27:47.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 518.555656ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7212024-11-22T20:27:47.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83") failed: Property not found. retry in 732.262922ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7222024-11-22T20:27:47.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d") failed: Property not found. retry in 1.444466385s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
7232024-11-22T20:27:47.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 525.558805ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7242024-11-22T20:27:48.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83") failed: Property not found. retry in 1.146872993s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7252024-11-22T20:27:48.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 1.193701271s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7262024-11-22T20:27:48.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d") failed: Property not found. retry in 1.345727439s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
7272024-11-22T20:27:49.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83") failed: Property not found. retry in 736.818927ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7282024-11-22T20:27:49.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d") failed: Property not found. retry in 997.56256ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7292024-11-22T20:27:50.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83") failed: Property not found. retry in 1.17768065s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7302024-11-22T20:27:50.268ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13074069519075209557 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
7312024-11-22T20:27:50.268ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1820273298759935205 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
7322024-11-22T20:27:51.338ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_2655aee7-1b4c-458e-bde8-4baa21483b3d
7332024-11-22T20:27:51.338ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_635ad13c-159b-401b-8372-a3dc22e52a83
7342024-11-22T20:27:51.338ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d
7352024-11-22T20:27:51.338ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7362024-11-22T20:27:51.339ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json"
7372024-11-22T20:27:51.339ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7382024-11-22T20:27:51.339ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json"
7392024-11-22T20:27:51.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9996497 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55002 req_id = e5ed0ceb-d65a-4c6b-9151-069b94eb327b response_code = 204 uri = /omicron-zones
7402024-11-22T20:27:51.341ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7412024-11-22T20:27:51.739ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
7422024-11-22T20:27:51.740ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
7432024-11-22T20:27:51.864ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 92.309501ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7442024-11-22T20:27:52.009ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7452024-11-22T20:27:52.111ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7462024-11-22T20:27:52.242ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7472024-11-22T20:27:52.242ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7482024-11-22T20:27:52.276ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7492024-11-22T20:27:52.277ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7502024-11-22T20:27:52.277ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7512024-11-22T20:27:52.306ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 635ad13c-159b-401b-8372-a3dc22e52a83 (service), filesystem_pool: Some(ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d (service), filesystem_pool: Some(ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2655aee7-1b4c-458e-bde8-4baa21483b3d (service), filesystem_pool: Some(ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6b0643ea-9bea-4ce2-9cf5-d13b104e8d32 (service), filesystem_pool: Some(ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a09ef2df-80e4-47a6-b40c-8f41d37b7458, kind: Service { id: 6b0643ea-9bea-4ce2-9cf5-d13b104e8d32 }, name: Name("ntp-6b0643ea-9bea-4ce2-9cf5-d13b104e8d32"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 172])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7522024-11-22T20:27:52.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44816
7532024-11-22T20:27:52.307ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7542024-11-22T20:27:52.307ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:178
7552024-11-22T20:27:52.307ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:178
7562024-11-22T20:27:52.307ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
7572024-11-22T20:27:52.307ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7582024-11-22T20:27:52.307ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7592024-11-22T20:27:52.307ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
7602024-11-22T20:27:52.307ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7612024-11-22T20:27:52.321ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7622024-11-22T20:27:52.353ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7632024-11-22T20:27:52.354ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7642024-11-22T20:27:52.354ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7652024-11-22T20:27:52.384ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 213, 172]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7662024-11-22T20:27:52.384ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = boundary_ntp
7672024-11-22T20:27:52.384ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7682024-11-22T20:27:52.384ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7692024-11-22T20:27:52.385ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7702024-11-22T20:27:52.385ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7712024-11-22T20:27:52.410ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32 file = illumos-utils/src/zone.rs:325
7722024-11-22T20:27:52.431ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32 file = illumos-utils/src/zone.rs:363
7732024-11-22T20:27:53.036ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7742024-11-22T20:27:53.036ZINFOSledAgent (ServiceManager): Booting oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7752024-11-22T20:27:53.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32") failed: Property not found. retry in 71.904562ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7762024-11-22T20:27:53.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32") failed: Property not found. retry in 114.950914ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7772024-11-22T20:27:53.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32") failed: Property not found. retry in 271.289961ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7782024-11-22T20:27:53.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32") failed: Property not found. retry in 597.072598ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7792024-11-22T20:27:54.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32") failed: Property not found. retry in 1.121608861s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7802024-11-22T20:27:55.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32") failed: Property not found. retry in 527.788905ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7812024-11-22T20:27:55.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32") failed: Property not found. retry in 1.371145912s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7822024-11-22T20:27:57.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32") failed: Property not found. retry in 1.139558672s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7832024-11-22T20:27:58.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32") failed: Property not found. retry in 640.178928ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7842024-11-22T20:27:59.151ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32
7852024-11-22T20:27:59.151ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7862024-11-22T20:27:59.151ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json"
7872024-11-22T20:27:59.151ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7882024-11-22T20:27:59.152ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json"
7892024-11-22T20:27:59.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6845342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44816 req_id = 04933a4d-af68-4e82-8a09-a58eb3926168 response_code = 204 uri = /omicron-zones
7902024-11-22T20:27:59.154ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7912024-11-22T20:27:59.184ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7922024-11-22T20:27:59.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62521
7932024-11-22T20:27:59.194ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7942024-11-22T20:27:59.194ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9633 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62521 req_id = 7436c222-fe69-43fc-9f76-f3731c396d93 response_code = 500 uri = /timesync
7952024-11-22T20:27:59.196ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7962024-11-22T20:27:59.374ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7972024-11-22T20:27:59.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38641
7982024-11-22T20:28:03.383ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7992024-11-22T20:28:03.383ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009476 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38641 req_id = c4eedd0b-bc13-49e2-bcbb-c7e4d1026798 response_code = 500 uri = /timesync
8002024-11-22T20:28:03.385ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8012024-11-22T20:28:03.385ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8022024-11-22T20:28:03.385ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13074069519075209557 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8032024-11-22T20:28:03.386ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1820273298759935205 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8042024-11-22T20:28:03.386ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 27630616853833714 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8052024-11-22T20:28:03.386ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13572281255774211921 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8062024-11-22T20:28:03.386ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13476524974708725865 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8072024-11-22T20:28:03.387ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8082024-11-22T20:28:03.516ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8092024-11-22T20:28:03.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50159
8102024-11-22T20:28:03.525ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
8112024-11-22T20:28:03.525ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8811 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50159 req_id = a0f48066-7381-4e78-a2c4-d56dc403d196 response_code = 500 uri = /timesync
8122024-11-22T20:28:03.526ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8132024-11-22T20:28:03.635ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8142024-11-22T20:28:03.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65001
8152024-11-22T20:28:07.467ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6b0643ea-9bea-4ce2-9cf5-d13b104e8d32': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
8162024-11-22T20:28:07.467ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009038 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65001 req_id = b159cc42-b39e-403f-ba19-336322184968 response_code = 500 uri = /timesync
8172024-11-22T20:28:07.470ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8182024-11-22T20:28:07.002ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8192024-11-22T20:28:07.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46369
8202024-11-22T20:28:07.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9421 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46369 req_id = d479e491-3c1a-49a4-a9da-ec5d17623bca response_code = 200 uri = /timesync
8212024-11-22T20:28:07.013ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8222024-11-22T20:28:07.013ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8232024-11-22T20:28:07.291ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8242024-11-22T20:28:07.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51213
8252024-11-22T20:28:07.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8058 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51213 req_id = 6310dd44-35a7-42e8-90a6-1b5af9cb63ce response_code = 200 uri = /timesync
8262024-11-22T20:28:07.301ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8272024-11-22T20:28:07.301ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8282024-11-22T20:28:07.614ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 238.423234ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8292024-11-22T20:28:07.666ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8302024-11-22T20:28:07.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45107
8312024-11-22T20:28:07.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7587 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45107 req_id = a5bb1ec6-3689-48a6-8512-52c1a160d936 response_code = 200 uri = /timesync
8322024-11-22T20:28:07.676ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8332024-11-22T20:28:07.676ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8342024-11-22T20:28:08.024ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8352024-11-22T20:28:08.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47881
8362024-11-22T20:28:08.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47881 req_id = 884165eb-e71f-4713-8678-3c10593f4bfe response_code = 200 uri = /timesync
8372024-11-22T20:28:08.036ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732307286.8585503, correction: 0.442524046 } file = sled-agent/src/rack_setup/service.rs:740
8382024-11-22T20:28:08.036ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8392024-11-22T20:28:08.373ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4387893693793564333 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8402024-11-22T20:28:08.373ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9041505944097503362 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8412024-11-22T20:28:08.559ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8422024-11-22T20:28:08.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52944
8432024-11-22T20:28:08.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52944 req_id = 501571c1-e047-4b4c-b6c7-82a1300b8b96 response_code = 200 uri = /timesync
8442024-11-22T20:28:08.570ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732307286.8585503, correction: 0.44108057 } file = sled-agent/src/rack_setup/service.rs:740
8452024-11-22T20:28:08.570ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8462024-11-22T20:28:08.989ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8472024-11-22T20:28:08.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41412
8482024-11-22T20:28:08.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41412 req_id = 608605bd-dac8-4b30-b9b4-863732ed54ca response_code = 200 uri = /timesync
8492024-11-22T20:28:09.000ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732307286.8585503, correction: 0.425773442 } file = sled-agent/src/rack_setup/service.rs:740
8502024-11-22T20:28:09.000ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8512024-11-22T20:28:09.558ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8522024-11-22T20:28:09.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56132
8532024-11-22T20:28:09.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8441 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56132 req_id = 347f37da-c9a6-4c98-a5b1-0d01b17d15d5 response_code = 200 uri = /timesync
8542024-11-22T20:28:09.569ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732307286.8585503, correction: 0.424238801 } file = sled-agent/src/rack_setup/service.rs:740
8552024-11-22T20:28:09.569ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8562024-11-22T20:28:09.922ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8572024-11-22T20:28:09.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47636
8582024-11-22T20:28:09.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8542 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47636 req_id = 957d2431-17ad-4817-bb1b-96550503100f response_code = 200 uri = /timesync
8592024-11-22T20:28:09.934ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732307286.8585503, correction: 0.425927311 } file = sled-agent/src/rack_setup/service.rs:740
8602024-11-22T20:28:09.934ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8612024-11-22T20:28:10.185ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40278
8622024-11-22T20:28:10.185ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40278 req_id = 213dedd3-1015-4898-afa5-46128e9ab178 response_code = 200 uri = /baseboard
8632024-11-22T20:28:10.715ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8642024-11-22T20:28:10.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36895
8652024-11-22T20:28:10.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36895 req_id = f7930c16-2803-42ea-9fce-abc443081c43 response_code = 200 uri = /timesync
8662024-11-22T20:28:10.725ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732307286.8585503, correction: 0.426039398 } file = sled-agent/src/rack_setup/service.rs:740
8672024-11-22T20:28:10.725ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8682024-11-22T20:28:11.634ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8692024-11-22T20:28:11.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50678
8702024-11-22T20:28:11.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50678 req_id = f168dfa1-59d5-4e33-ad9d-48d3e794184c response_code = 200 uri = /timesync
8712024-11-22T20:28:11.644ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732307286.8585503, correction: 0.423557132 } file = sled-agent/src/rack_setup/service.rs:740
8722024-11-22T20:28:11.644ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8732024-11-22T20:28:12.630ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8742024-11-22T20:28:12.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53054
8752024-11-22T20:28:12.637ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8762024-11-22T20:28:12.637ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8772024-11-22T20:28:12.639ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13074069519075209557 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8782024-11-22T20:28:12.639ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1820273298759935205 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8792024-11-22T20:28:12.639ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 27630616853833714 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8802024-11-22T20:28:12.639ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13572281255774211921 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8812024-11-22T20:28:12.639ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13476524974708725865 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
8822024-11-22T20:28:12.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11830 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53054 req_id = 296bf759-1eb7-4fdb-a8bd-9b9703fe6a4c response_code = 200 uri = /timesync
8832024-11-22T20:28:12.646ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307292.3264892, correction: 0.421519905 } file = sled-agent/src/rack_setup/service.rs:740
8842024-11-22T20:28:12.646ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8852024-11-22T20:28:13.814ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8862024-11-22T20:28:13.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37618
8872024-11-22T20:28:13.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8762 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37618 req_id = 856bca92-d300-4b9a-9007-9388f473944d response_code = 200 uri = /timesync
8882024-11-22T20:28:13.826ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307293.5234609, correction: 0.418119878 } file = sled-agent/src/rack_setup/service.rs:740
8892024-11-22T20:28:13.826ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8902024-11-22T20:28:14.735ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8912024-11-22T20:28:14.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60583
8922024-11-22T20:28:14.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8529 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60583 req_id = ffa3fa01-ab83-4f27-8665-1446057eb983 response_code = 200 uri = /timesync
8932024-11-22T20:28:14.747ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307294.3489528, correction: 0.415569395 } file = sled-agent/src/rack_setup/service.rs:740
8942024-11-22T20:28:14.747ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8952024-11-22T20:28:17.172ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8962024-11-22T20:28:17.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53987
8972024-11-22T20:28:17.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8537 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53987 req_id = 54992cf1-cf3e-4c66-a1aa-b95cb22fc4ec response_code = 200 uri = /timesync
8982024-11-22T20:28:17.183ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307296.5425923, correction: 0.408904433 } file = sled-agent/src/rack_setup/service.rs:740
8992024-11-22T20:28:17.183ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9002024-11-22T20:28:18.404ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4387893693793564333 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9012024-11-22T20:28:18.404ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9041505944097503362 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9022024-11-22T20:28:20.535ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9032024-11-22T20:28:20.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38501
9042024-11-22T20:28:20.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8897 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38501 req_id = a432e82c-0e79-4e86-9a99-6d6093594651 response_code = 200 uri = /timesync
9052024-11-22T20:28:20.548ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307300.4399362, correction: 0.399993896 } file = sled-agent/src/rack_setup/service.rs:740
9062024-11-22T20:28:20.548ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9072024-11-22T20:28:22.667ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9082024-11-22T20:28:22.667ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9092024-11-22T20:28:22.668ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13074069519075209557 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9102024-11-22T20:28:22.668ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1820273298759935205 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9112024-11-22T20:28:22.668ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 27630616853833714 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9122024-11-22T20:28:22.668ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13572281255774211921 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9132024-11-22T20:28:22.668ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13476524974708725865 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9142024-11-22T20:28:22.920ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9152024-11-22T20:28:22.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34862
9162024-11-22T20:28:22.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8550 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34862 req_id = 42b02505-a676-433d-95bf-f18cbdb2f542 response_code = 200 uri = /timesync
9172024-11-22T20:28:22.933ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307301.468192, correction: 0.393522888 } file = sled-agent/src/rack_setup/service.rs:740
9182024-11-22T20:28:22.933ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9192024-11-22T20:28:22.934ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 399.665378ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9202024-11-22T20:28:26.258ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9212024-11-22T20:28:26.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44855
9222024-11-22T20:28:26.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44855 req_id = a59ca20d-ddb2-4e72-9e44-78710c37ed2f response_code = 200 uri = /timesync
9232024-11-22T20:28:26.272ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307305.4539318, correction: 0.38451764 } file = sled-agent/src/rack_setup/service.rs:740
9242024-11-22T20:28:26.272ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9252024-11-22T20:28:28.433ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4387893693793564333 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9262024-11-22T20:28:28.433ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9041505944097503362 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9272024-11-22T20:28:30.065ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9282024-11-22T20:28:30.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57819
9292024-11-22T20:28:30.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9648 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57819 req_id = b63806db-417b-431b-acfd-936b05a8bb1a response_code = 200 uri = /timesync
9302024-11-22T20:28:30.079ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307308.9754865, correction: 0.374248266 } file = sled-agent/src/rack_setup/service.rs:740
9312024-11-22T20:28:30.079ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9322024-11-22T20:28:32.696ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9332024-11-22T20:28:32.697ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9342024-11-22T20:28:32.697ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13074069519075209557 reason = Duration(60s) sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9352024-11-22T20:28:32.697ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1820273298759935205 reason = Duration(60s) sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9362024-11-22T20:28:32.697ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 27630616853833714 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9372024-11-22T20:28:32.698ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13572281255774211921 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9382024-11-22T20:28:32.698ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13476524974708725865 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9392024-11-22T20:28:34.408ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9402024-11-22T20:28:34.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59236
9412024-11-22T20:28:34.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8960 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59236 req_id = 69cd82b8-85cd-4fc6-bb33-16aea8952b2d response_code = 200 uri = /timesync
9422024-11-22T20:28:34.420ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307311.4752395, correction: 0.362543821 } file = sled-agent/src/rack_setup/service.rs:740
9432024-11-22T20:28:34.420ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9442024-11-22T20:28:38.410ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 781.69409ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9452024-11-22T20:28:38.462ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4387893693793564333 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9462024-11-22T20:28:38.462ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9041505944097503362 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9472024-11-22T20:28:40.300ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50688
9482024-11-22T20:28:40.300ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50688 req_id = cc9c59e5-d44c-429d-9604-ef3b41428f90 response_code = 200 uri = /baseboard
9492024-11-22T20:28:41.745ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9502024-11-22T20:28:41.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61937
9512024-11-22T20:28:41.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8971 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61937 req_id = 5a87bedb-a9ca-4b23-b8ca-7ef730930add response_code = 200 uri = /timesync
9522024-11-22T20:28:41.756ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307319.7926073, correction: 0.342752725 } file = sled-agent/src/rack_setup/service.rs:740
9532024-11-22T20:28:41.756ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9542024-11-22T20:28:42.725ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9552024-11-22T20:28:42.726ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9562024-11-22T20:28:42.726ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 27630616853833714 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9572024-11-22T20:28:42.726ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13572281255774211921 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9582024-11-22T20:28:42.726ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13476524974708725865 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9592024-11-22T20:28:48.490ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4387893693793564333 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9602024-11-22T20:28:48.491ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9041505944097503362 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9612024-11-22T20:28:49.435ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9622024-11-22T20:28:49.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35311
9632024-11-22T20:28:49.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8996 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35311 req_id = a02336fa-21c4-41fe-9e05-a44855a4f6ac response_code = 200 uri = /timesync
9642024-11-22T20:28:49.447ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307327.877269, correction: 0.321944833 } file = sled-agent/src/rack_setup/service.rs:740
9652024-11-22T20:28:49.447ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9662024-11-22T20:28:52.755ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9672024-11-22T20:28:52.755ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9682024-11-22T20:28:52.755ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 27630616853833714 reason = Duration(60s) sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9692024-11-22T20:28:52.756ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13572281255774211921 reason = Duration(60s) sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9702024-11-22T20:28:52.756ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13476524974708725865 reason = Duration(60s) sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9712024-11-22T20:28:54.269ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.378901362s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9722024-11-22T20:28:55.195ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9732024-11-22T20:28:55.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62990
9742024-11-22T20:28:55.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8774 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62990 req_id = 8de33a3c-6d74-4fa4-bd45-de4cfba57f1e response_code = 200 uri = /timesync
9752024-11-22T20:28:55.206ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307327.877269, correction: 0.306389034 } file = sled-agent/src/rack_setup/service.rs:740
9762024-11-22T20:28:55.206ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9772024-11-22T20:28:58.519ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4387893693793564333 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9782024-11-22T20:28:58.519ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9041505944097503362 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9792024-11-22T20:29:02.784ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9802024-11-22T20:29:02.784ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9812024-11-22T20:29:07.209ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9822024-11-22T20:29:07.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34657
9832024-11-22T20:29:07.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34657 req_id = c921551d-cdb2-429f-a33e-d590fee0a3c9 response_code = 200 uri = /timesync
9842024-11-22T20:29:07.221ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307344.0018847, correction: 0.274137288 } file = sled-agent/src/rack_setup/service.rs:740
9852024-11-22T20:29:07.221ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9862024-11-22T20:29:08.548ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4387893693793564333 reason = Duration(60s) sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9872024-11-22T20:29:08.549ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9041505944097503362 reason = Duration(60s) sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9882024-11-22T20:29:10.415ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59070
9892024-11-22T20:29:10.415ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59070 req_id = 1df094f6-c9b3-4f09-89e1-8a2a5950c5a5 response_code = 200 uri = /baseboard
9902024-11-22T20:29:11.733ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.8990921s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9912024-11-22T20:29:12.813ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9922024-11-22T20:29:12.814ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9932024-11-22T20:29:17.711ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9942024-11-22T20:29:17.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64515
9952024-11-22T20:29:17.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64515 req_id = d2f25e12-87a2-409c-a636-880ace8a5463 response_code = 200 uri = /timesync
9962024-11-22T20:29:17.725ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307351.6244514, correction: 0.245965481 } file = sled-agent/src/rack_setup/service.rs:740
9972024-11-22T20:29:17.725ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9982024-11-22T20:29:22.843ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
9992024-11-22T20:29:22.843ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10002024-11-22T20:29:30.322ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10012024-11-22T20:29:30.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50889
10022024-11-22T20:29:30.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8923 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50889 req_id = da5fe0f5-b916-40e5-ba2f-915290072d3c response_code = 200 uri = /timesync
10032024-11-22T20:29:30.335ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307368.178791, correction: 0.211940452 } file = sled-agent/src/rack_setup/service.rs:740
10042024-11-22T20:29:30.335ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10052024-11-22T20:29:32.724ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.665020682s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10062024-11-22T20:29:32.872ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10072024-11-22T20:29:32.873ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10082024-11-22T20:29:40.531ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50089
10092024-11-22T20:29:40.531ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50089 req_id = b9693cf7-2d5e-478b-9acb-b333520a0743 response_code = 200 uri = /baseboard
10102024-11-22T20:29:42.902ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10112024-11-22T20:29:42.902ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10122024-11-22T20:29:43.490ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10132024-11-22T20:29:43.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59451
10142024-11-22T20:29:43.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9883 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59451 req_id = e8859507-e46b-4c6b-8ea7-f239d59452d3 response_code = 200 uri = /timesync
10152024-11-22T20:29:43.504ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732307376.126753, correction: 0.176359817 } file = sled-agent/src/rack_setup/service.rs:740
10162024-11-22T20:29:43.504ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10172024-11-22T20:29:52.930ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10182024-11-22T20:29:52.930ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10192024-11-22T20:29:54.483ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.133371042s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10202024-11-22T20:30:02.960ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10212024-11-22T20:30:02.960ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10222024-11-22T20:30:09.446ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10232024-11-22T20:30:09.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38369
10242024-11-22T20:30:09.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38369 req_id = 23222532-e71e-400a-bb79-3ead5f6ca6e3 response_code = 200 uri = /timesync
10252024-11-22T20:30:09.458ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1209934681, ip_addr: 72.30.35.89, stratum: 3, ref_time: 1732307409.0443776, correction: 0.107998475 } file = sled-agent/src/rack_setup/service.rs:740
10262024-11-22T20:30:09.458ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10272024-11-22T20:30:10.645ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53458
10282024-11-22T20:30:10.645ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53458 req_id = b04761bc-f302-44ae-bbc3-aac2717e6489 response_code = 200 uri = /baseboard
10292024-11-22T20:30:12.989ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10302024-11-22T20:30:12.989ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10312024-11-22T20:30:23.018ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7052134830899644607 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10322024-11-22T20:30:23.018ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1216063582467810517 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10332024-11-22T20:30:25.736ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 40.460684822s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10342024-11-22T20:30:31.756ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10352024-11-22T20:30:31.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45412
10362024-11-22T20:30:31.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21612 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45412 req_id = b3ed12bd-59d7-4f97-a9a5-05cc345a40c9 response_code = 200 uri = /timesync
10372024-11-22T20:30:31.780ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T20:28:52.756899781Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13476524974708725865 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10382024-11-22T20:30:31.780ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T20:29:08.549044218Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9041505944097503362 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10392024-11-22T20:30:31.780ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T20:28:32.697194010Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13074069519075209557 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10402024-11-22T20:30:31.780ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T20:28:32.697790816Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1820273298759935205 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10412024-11-22T20:30:31.780ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T20:29:08.548707460Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4387893693793564333 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10422024-11-22T20:30:31.781ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T20:28:52.756421486Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13572281255774211921 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10432024-11-22T20:30:31.781ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T20:28:52.755825774Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 27630616853833714 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
10442024-11-22T20:30:31.783ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1209934681, ip_addr: 72.30.35.89, stratum: 3, ref_time: 1732307429.1604168, correction: 0.047798395 } file = sled-agent/src/rack_setup/service.rs:740
10452024-11-22T20:30:31.783ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
10462024-11-22T20:30:31.813ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 635ad13c-159b-401b-8372-a3dc22e52a83 (service), filesystem_pool: Some(ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d (service), filesystem_pool: Some(ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2655aee7-1b4c-458e-bde8-4baa21483b3d (service), filesystem_pool: Some(ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6b0643ea-9bea-4ce2-9cf5-d13b104e8d32 (service), filesystem_pool: Some(ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a09ef2df-80e4-47a6-b40c-8f41d37b7458, kind: Service { id: 6b0643ea-9bea-4ce2-9cf5-d13b104e8d32 }, name: Name("ntp-6b0643ea-9bea-4ce2-9cf5-d13b104e8d32"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 172])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 5018f446-cff3-4149-a59e-5ceacf11162c (service), filesystem_pool: Some(ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External } } } }, OmicronZoneConfig { id: f3b3c82f-1f11-4258-be62-dc32f28f4793 (service), filesystem_pool: Some(ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External } } } }, OmicronZoneConfig { id: 36af9c59-780c-4473-983b-faa8b0e38a77 (service), filesystem_pool: Some(ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External } } } }, OmicronZoneConfig { id: ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf (service), filesystem_pool: Some(ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External } } } }, OmicronZoneConfig { id: 67773d27-0a74-43cc-9317-5d6bad7a681a (service), filesystem_pool: Some(ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10472024-11-22T20:30:31.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45100
10482024-11-22T20:30:31.813ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10492024-11-22T20:30:31.813ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:178
10502024-11-22T20:30:31.813ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:178
10512024-11-22T20:30:31.813ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
10522024-11-22T20:30:31.813ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10532024-11-22T20:30:31.813ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10542024-11-22T20:30:31.814ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
10552024-11-22T20:30:31.814ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10562024-11-22T20:30:31.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10572024-11-22T20:30:31.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10582024-11-22T20:30:31.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10592024-11-22T20:30:31.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10602024-11-22T20:30:31.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10612024-11-22T20:30:31.986ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c file = illumos-utils/src/zone.rs:325
10622024-11-22T20:30:31.990ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77 file = illumos-utils/src/zone.rs:325
10632024-11-22T20:30:31.994ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf file = illumos-utils/src/zone.rs:325
10642024-11-22T20:30:31.998ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a file = illumos-utils/src/zone.rs:325
10652024-11-22T20:30:32.003ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793 file = illumos-utils/src/zone.rs:325
10662024-11-22T20:30:32.008ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c file = illumos-utils/src/zone.rs:363
10672024-11-22T20:30:32.012ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77 file = illumos-utils/src/zone.rs:363
10682024-11-22T20:30:32.017ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf file = illumos-utils/src/zone.rs:363
10692024-11-22T20:30:32.021ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a file = illumos-utils/src/zone.rs:363
10702024-11-22T20:30:32.027ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793 file = illumos-utils/src/zone.rs:363
10712024-11-22T20:30:34.918ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='67773d27-0a74-43cc-9317-5d6bad7a681a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10722024-11-22T20:30:34.918ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f3b3c82f-1f11-4258-be62-dc32f28f4793'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10732024-11-22T20:30:34.918ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
10742024-11-22T20:30:34.924ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
10752024-11-22T20:30:34.932ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5018f446-cff3-4149-a59e-5ceacf11162c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10762024-11-22T20:30:34.932ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
10772024-11-22T20:30:34.950ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='36af9c59-780c-4473-983b-faa8b0e38a77'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10782024-11-22T20:30:34.950ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
10792024-11-22T20:30:34.975ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10802024-11-22T20:30:34.975ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
10812024-11-22T20:30:35.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 32.723989ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
10822024-11-22T20:30:35.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 40.956611ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
10832024-11-22T20:30:35.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 72.641259ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
10842024-11-22T20:30:35.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 51.32659ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
10852024-11-22T20:30:35.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 103.558238ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
10862024-11-22T20:30:35.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 52.598165ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
10872024-11-22T20:30:35.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 138.778563ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
10882024-11-22T20:30:35.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 123.360638ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
10892024-11-22T20:30:35.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 135.705182ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
10902024-11-22T20:30:35.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 97.478689ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
10912024-11-22T20:30:36.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 205.3126ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
10922024-11-22T20:30:36.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 203.611737ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
10932024-11-22T20:30:36.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 152.487864ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
10942024-11-22T20:30:36.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 217.4046ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
10952024-11-22T20:30:36.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 236.195653ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
10962024-11-22T20:30:36.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 502.464712ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
10972024-11-22T20:30:36.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 412.09341ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
10982024-11-22T20:30:36.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 527.703287ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
10992024-11-22T20:30:36.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 254.317462ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
11002024-11-22T20:30:36.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 422.600131ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
11012024-11-22T20:30:36.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 1.170212168s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
11022024-11-22T20:30:36.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 998.36031ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
11032024-11-22T20:30:37.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 1.08722149s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
11042024-11-22T20:30:37.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 840.271051ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
11052024-11-22T20:30:37.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 806.584708ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
11062024-11-22T20:30:38.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 607.602941ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
11072024-11-22T20:30:38.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 1.077548011s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
11082024-11-22T20:30:38.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 1.348492024s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
11092024-11-22T20:30:38.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 567.694469ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
11102024-11-22T20:30:38.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 1.30535418s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
11112024-11-22T20:30:38.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 575.436012ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
11122024-11-22T20:30:38.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 1.063288515s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
11132024-11-22T20:30:39.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 809.935694ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
11142024-11-22T20:30:39.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 1.103740655s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
11152024-11-22T20:30:39.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 1.102624187s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
11162024-11-22T20:30:39.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 532.430001ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
11172024-11-22T20:30:39.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 1.443596214s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
11182024-11-22T20:30:39.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 1.222280263s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
11192024-11-22T20:30:40.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 906.090249ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
11202024-11-22T20:30:40.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 1.095060335s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
11212024-11-22T20:30:40.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 587.000114ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
11222024-11-22T20:30:40.767ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51131
11232024-11-22T20:30:40.767ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51131 req_id = 35de8b19-d754-4223-b2b2-29fe5e3ccaaa response_code = 200 uri = /baseboard
11242024-11-22T20:30:40.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 1.155440529s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
11252024-11-22T20:30:41.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 1.431005735s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
11262024-11-22T20:30:41.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 1.082514499s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
11272024-11-22T20:30:41.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 575.869928ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
11282024-11-22T20:30:41.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 1.234559644s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
11292024-11-22T20:30:41.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 1.003468005s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
11302024-11-22T20:30:42.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 1.451426402s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
11312024-11-22T20:30:42.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 1.358165111s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
11322024-11-22T20:30:42.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 722.8664ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
11332024-11-22T20:30:42.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 1.07774749s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
11342024-11-22T20:30:42.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 1.078241653s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
11352024-11-22T20:30:43.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793") failed: Property not found. retry in 1.085284444s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
11362024-11-22T20:30:43.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a") failed: Property not found. retry in 975.850769ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
11372024-11-22T20:30:43.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77") failed: Property not found. retry in 1.22202647s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
11382024-11-22T20:30:43.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c") failed: Property not found. retry in 728.793506ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
11392024-11-22T20:30:43.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf") failed: Property not found. retry in 620.586159ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
11402024-11-22T20:30:44.895ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_5018f446-cff3-4149-a59e-5ceacf11162c
11412024-11-22T20:30:44.895ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77
11422024-11-22T20:30:44.895ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf
11432024-11-22T20:30:44.895ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_67773d27-0a74-43cc-9317-5d6bad7a681a
11442024-11-22T20:30:44.895ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_f3b3c82f-1f11-4258-be62-dc32f28f4793
11452024-11-22T20:30:44.895ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
11462024-11-22T20:30:44.895ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json"
11472024-11-22T20:30:44.895ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
11482024-11-22T20:30:44.896ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json"
11492024-11-22T20:30:44.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13047622 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45100 req_id = d7397a76-c656-478e-bb88-75f638720e72 response_code = 204 uri = /omicron-zones
11502024-11-22T20:30:44.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52743
11512024-11-22T20:30:44.964ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 33946 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52743 req_id = 983c3ec8-54e0-45e3-a90a-92169072ac7c response_code = 500 uri = /cockroachdb
11522024-11-22T20:30:44.965ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "983c3ec8-54e0-45e3-a90a-92169072ac7c", "content-length": "124", "date": "Fri, 22 Nov 2024 20:30:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "983c3ec8-54e0-45e3-a90a-92169072ac7c" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 53.652036ms
11532024-11-22T20:30:45.048ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28353 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52743 req_id = 00f2ed60-3559-47af-8b50-9dc40fcad5f7 response_code = 500 uri = /cockroachdb
11542024-11-22T20:30:45.048ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "00f2ed60-3559-47af-8b50-9dc40fcad5f7", "content-length": "124", "date": "Fri, 22 Nov 2024 20:30:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "00f2ed60-3559-47af-8b50-9dc40fcad5f7" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 67.895353ms
11552024-11-22T20:30:45.149ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 32399 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52743 req_id = 402618f8-839c-49cd-ac85-d27317cecf4a response_code = 500 uri = /cockroachdb
11562024-11-22T20:30:45.149ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "402618f8-839c-49cd-ac85-d27317cecf4a", "content-length": "124", "date": "Fri, 22 Nov 2024 20:30:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "402618f8-839c-49cd-ac85-d27317cecf4a" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 101.115081ms
11572024-11-22T20:30:45.281ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29565 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52743 req_id = 17df6c04-910e-40e0-acc9-969fd36e6755 response_code = 500 uri = /cockroachdb
11582024-11-22T20:30:45.281ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "17df6c04-910e-40e0-acc9-969fd36e6755", "content-length": "124", "date": "Fri, 22 Nov 2024 20:30:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "17df6c04-910e-40e0-acc9-969fd36e6755" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 177.28261ms
11592024-11-22T20:30:45.488ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_36af9c59-780c-4473-983b-faa8b0e38a77 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27215 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52743 req_id = 3a0bf898-d529-4ab7-9a00-6a0337d67301 response_code = 500 uri = /cockroachdb
11602024-11-22T20:30:45.488ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3a0bf898-d529-4ab7-9a00-6a0337d67301", "content-length": "124", "date": "Fri, 22 Nov 2024 20:30:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3a0bf898-d529-4ab7-9a00-6a0337d67301" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 129.529814ms
11612024-11-22T20:30:45.648ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3801
11622024-11-22T20:31:02.644ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3819
11632024-11-22T20:31:10.424ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3842
11642024-11-22T20:31:10.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24794246 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52743 req_id = f54a8ade-41f6-4ac5-be45-56c386885533 response_code = 204 uri = /cockroachdb
11652024-11-22T20:31:10.489ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 635ad13c-159b-401b-8372-a3dc22e52a83 (service), filesystem_pool: Some(ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d9e4e5d4-72dc-41eb-a5e4-65f9efa2ca5d (service), filesystem_pool: Some(ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2655aee7-1b4c-458e-bde8-4baa21483b3d (service), filesystem_pool: Some(ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6b0643ea-9bea-4ce2-9cf5-d13b104e8d32 (service), filesystem_pool: Some(ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a09ef2df-80e4-47a6-b40c-8f41d37b7458, kind: Service { id: 6b0643ea-9bea-4ce2-9cf5-d13b104e8d32 }, name: Name("ntp-6b0643ea-9bea-4ce2-9cf5-d13b104e8d32"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 172])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 5018f446-cff3-4149-a59e-5ceacf11162c (service), filesystem_pool: Some(ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External } } } }, OmicronZoneConfig { id: f3b3c82f-1f11-4258-be62-dc32f28f4793 (service), filesystem_pool: Some(ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External } } } }, OmicronZoneConfig { id: 36af9c59-780c-4473-983b-faa8b0e38a77 (service), filesystem_pool: Some(ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External } } } }, OmicronZoneConfig { id: ad59cc0f-c77e-4a79-92da-a8ec5b8fb0bf (service), filesystem_pool: Some(ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External } } } }, OmicronZoneConfig { id: 67773d27-0a74-43cc-9317-5d6bad7a681a (service), filesystem_pool: Some(ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External } } } }, OmicronZoneConfig { id: 629b0356-ba24-4504-89b1-926bdda66829 (service), filesystem_pool: Some(ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 (service), filesystem_pool: Some(ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 (service), filesystem_pool: Some(ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 (service), filesystem_pool: Some(ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 (service), filesystem_pool: Some(ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1c039189-a5ba-4d68-ace9-448d7d9a3f66 (service), filesystem_pool: Some(ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: f1423f48-486c-47b1-8bb5-aa7fe40d2647 (service), filesystem_pool: Some(ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External } } } }, OmicronZoneConfig { id: 66fea123-b70e-478e-b3c1-a949874739b5 (service), filesystem_pool: Some(ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: e41eaf1d-bd79-475b-9a28-760154bc92c0 (service), filesystem_pool: Some(ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 34169942-b5d1-4d61-8c71-79c36302c9ec (service), filesystem_pool: Some(ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 7bfceb24-d461-40ce-8d0a-00e78380ff73 (service), filesystem_pool: Some(ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External } } } }, OmicronZoneConfig { id: d0321183-a49c-4480-b2c7-d268c37c9e85 (service), filesystem_pool: Some(ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External } } } }, OmicronZoneConfig { id: d9c2b42c-283d-4702-a1b3-9e7aa661833f (service), filesystem_pool: Some(ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0b445703-3f22-4947-b740-b6fa5cd0ad57 (service), filesystem_pool: Some(ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2bc22f8c-738b-408c-b709-f243d852ede1 (service), filesystem_pool: Some(ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External } } } }, OmicronZoneConfig { id: 75de5901-fe9a-4840-8d2c-e4fcf3ab3f90 (service), filesystem_pool: Some(ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External } } } }, OmicronZoneConfig { id: 42916f4f-edf0-4dc5-9846-22e69c4ae5d5 (service), filesystem_pool: Some(ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 53d5de21-8a53-47fc-905a-307592526d1b (service), filesystem_pool: Some(ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External } } } }, OmicronZoneConfig { id: 3427952d-8b90-4d58-8b73-11761ced1464 (service), filesystem_pool: Some(ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11662024-11-22T20:31:10.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64553
11672024-11-22T20:31:10.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11682024-11-22T20:31:10.490ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:178
11692024-11-22T20:31:10.490ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:178
11702024-11-22T20:31:10.490ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
11712024-11-22T20:31:10.490ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11722024-11-22T20:31:10.491ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11732024-11-22T20:31:10.492ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
11742024-11-22T20:31:10.492ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11752024-11-22T20:31:10.648ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11762024-11-22T20:31:10.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11772024-11-22T20:31:10.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11782024-11-22T20:31:10.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11792024-11-22T20:31:10.675ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11802024-11-22T20:31:10.675ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11812024-11-22T20:31:10.675ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11822024-11-22T20:31:10.700ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11832024-11-22T20:31:10.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11842024-11-22T20:31:10.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11852024-11-22T20:31:10.701ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11862024-11-22T20:31:10.847ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48018
11872024-11-22T20:31:10.852ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48018 req_id = db027a80-6528-43d2-921f-099329aa5e9f response_code = 200 uri = /baseboard
11882024-11-22T20:31:10.883ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11892024-11-22T20:31:10.883ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11902024-11-22T20:31:10.945ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11912024-11-22T20:31:10.945ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11922024-11-22T20:31:10.945ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11932024-11-22T20:31:10.945ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11942024-11-22T20:31:10.945ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11952024-11-22T20:31:10.945ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11962024-11-22T20:31:10.946ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57 file = illumos-utils/src/zone.rs:325
11972024-11-22T20:31:10.951ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1 file = illumos-utils/src/zone.rs:325
11982024-11-22T20:31:10.956ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0 file = illumos-utils/src/zone.rs:325
11992024-11-22T20:31:10.963ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73 file = illumos-utils/src/zone.rs:325
12002024-11-22T20:31:10.969ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f file = illumos-utils/src/zone.rs:325
12012024-11-22T20:31:10.974ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90 file = illumos-utils/src/zone.rs:325
12022024-11-22T20:31:10.980ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5 file = illumos-utils/src/zone.rs:325
12032024-11-22T20:31:11.132ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57 file = illumos-utils/src/zone.rs:363
12042024-11-22T20:31:11.137ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1 file = illumos-utils/src/zone.rs:363
12052024-11-22T20:31:11.142ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0 file = illumos-utils/src/zone.rs:363
12062024-11-22T20:31:11.147ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73 file = illumos-utils/src/zone.rs:363
12072024-11-22T20:31:11.151ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f file = illumos-utils/src/zone.rs:363
12082024-11-22T20:31:11.156ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90 file = illumos-utils/src/zone.rs:363
12092024-11-22T20:31:11.161ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5 file = illumos-utils/src/zone.rs:363
12102024-11-22T20:31:11.166ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b file = illumos-utils/src/zone.rs:325
12112024-11-22T20:31:11.172ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464 file = illumos-utils/src/zone.rs:325
12122024-11-22T20:31:11.177ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647 file = illumos-utils/src/zone.rs:325
12132024-11-22T20:31:11.183ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66 file = illumos-utils/src/zone.rs:325
12142024-11-22T20:31:11.189ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5 file = illumos-utils/src/zone.rs:325
12152024-11-22T20:31:11.195ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec file = illumos-utils/src/zone.rs:325
12162024-11-22T20:31:11.201ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85 file = illumos-utils/src/zone.rs:325
12172024-11-22T20:31:11.264ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12182024-11-22T20:31:11.325ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12192024-11-22T20:31:11.325ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b file = illumos-utils/src/zone.rs:363
12202024-11-22T20:31:11.354ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464 file = illumos-utils/src/zone.rs:363
12212024-11-22T20:31:11.368ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647 file = illumos-utils/src/zone.rs:363
12222024-11-22T20:31:11.377ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66 file = illumos-utils/src/zone.rs:363
12232024-11-22T20:31:11.385ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5 file = illumos-utils/src/zone.rs:363
12242024-11-22T20:31:11.392ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec file = illumos-utils/src/zone.rs:363
12252024-11-22T20:31:11.402ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85 file = illumos-utils/src/zone.rs:363
12262024-11-22T20:31:11.469ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12272024-11-22T20:31:11.531ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12282024-11-22T20:31:11.590ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12292024-11-22T20:31:11.593ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12302024-11-22T20:31:11.593ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12312024-11-22T20:31:11.649ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 236, 173]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12322024-11-22T20:31:11.649ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
12332024-11-22T20:31:11.652ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12342024-11-22T20:31:11.652ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12352024-11-22T20:31:11.704ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 197, 227]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12362024-11-22T20:31:11.704ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12372024-11-22T20:31:11.706ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12382024-11-22T20:31:11.706ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12392024-11-22T20:31:11.761ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 158, 156]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12402024-11-22T20:31:11.761ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12412024-11-22T20:31:11.762ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12422024-11-22T20:31:11.762ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12432024-11-22T20:31:11.819ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 226, 199]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12442024-11-22T20:31:11.819ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
12452024-11-22T20:31:11.819ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12462024-11-22T20:31:11.819ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12472024-11-22T20:31:11.819ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12482024-11-22T20:31:11.819ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12492024-11-22T20:31:11.821ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12502024-11-22T20:31:11.821ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12512024-11-22T20:31:11.878ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 239, 215]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12522024-11-22T20:31:11.878ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12532024-11-22T20:31:11.878ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12542024-11-22T20:31:11.878ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12552024-11-22T20:31:11.878ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12562024-11-22T20:31:11.880ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12572024-11-22T20:31:11.883ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12582024-11-22T20:31:11.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12592024-11-22T20:31:11.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12602024-11-22T20:31:11.885ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12612024-11-22T20:31:12.060ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12622024-11-22T20:31:12.060ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12632024-11-22T20:31:12.060ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829 file = illumos-utils/src/zone.rs:325
12642024-11-22T20:31:12.071ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37 file = illumos-utils/src/zone.rs:325
12652024-11-22T20:31:12.084ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12662024-11-22T20:31:12.084ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12672024-11-22T20:31:12.085ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817 file = illumos-utils/src/zone.rs:325
12682024-11-22T20:31:12.105ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12692024-11-22T20:31:12.111ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12702024-11-22T20:31:12.111ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829 file = illumos-utils/src/zone.rs:363
12712024-11-22T20:31:12.121ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37 file = illumos-utils/src/zone.rs:363
12722024-11-22T20:31:12.134ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12732024-11-22T20:31:12.186ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12742024-11-22T20:31:12.227ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817 file = illumos-utils/src/zone.rs:363
12752024-11-22T20:31:12.240ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4 file = illumos-utils/src/zone.rs:325
12762024-11-22T20:31:12.253ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693 file = illumos-utils/src/zone.rs:325
12772024-11-22T20:31:12.283ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4 file = illumos-utils/src/zone.rs:363
12782024-11-22T20:31:12.296ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693 file = illumos-utils/src/zone.rs:363
12792024-11-22T20:31:23.091ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12802024-11-22T20:31:23.092ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
12812024-11-22T20:31:23.169ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_04456916-263d-47e8-84ad-1a50c9bd09d7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='aec5ee40-8949-4485-b97e-33fa8d72ffb1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12822024-11-22T20:31:23.170ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e83de9a9-73fc-4157-8f0d-bc628401b262/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='98dd5613-1e33-4f88-a551-579aca2feb76'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12832024-11-22T20:31:23.170ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='58186f21-71cb-4c6b-b0b3-d959b56015bd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12842024-11-22T20:31:23.171ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='785e1fa0-a3aa-457b-8428-1fcfd767f300'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12852024-11-22T20:31:23.171ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='eb70d342-7140-474f-89fe-410bff943609'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12862024-11-22T20:31:23.171ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
12872024-11-22T20:31:23.210ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8c870c6a-53aa-40e3-8b74-681d946263cd/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='83839f5f-0096-4c47-98ce-cf2523324817'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12882024-11-22T20:31:23.210ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
12892024-11-22T20:31:23.217ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6192e0c0-75f6-422c-9444-5c281ce64c40/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='880d76d5-61d5-4b5b-941f-c8d3b03fbefd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12902024-11-22T20:31:23.217ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12912024-11-22T20:31:23.217ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
12922024-11-22T20:31:23.254ZINFOSledAgent (ServiceManager): Booting oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
12932024-11-22T20:31:23.260ZINFOSledAgent (ServiceManager): Booting oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
12942024-11-22T20:31:23.267ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12952024-11-22T20:31:23.267ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
12962024-11-22T20:31:23.273ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
12972024-11-22T20:31:23.279ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
12982024-11-22T20:31:23.285ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
12992024-11-22T20:31:23.717ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='1c039189-a5ba-4d68-ace9-448d7d9a3f66'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13002024-11-22T20:31:23.717ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
13012024-11-22T20:31:27.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 67.960376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
13022024-11-22T20:31:27.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 25.261498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
13032024-11-22T20:31:28.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 74.115647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
13042024-11-22T20:31:28.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 102.412006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
13052024-11-22T20:31:29.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 39.779409ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
13062024-11-22T20:31:29.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 40.799706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
13072024-11-22T20:31:29.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 49.158853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
13082024-11-22T20:31:29.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 36.184815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
13092024-11-22T20:31:29.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 35.602034ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
13102024-11-22T20:31:29.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 60.336781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
13112024-11-22T20:31:29.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 65.206509ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
13122024-11-22T20:31:29.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 29.076011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
13132024-11-22T20:31:29.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 69.418796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
13142024-11-22T20:31:29.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 91.679481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
13152024-11-22T20:31:29.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 234.83783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
13162024-11-22T20:31:29.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 113.787926ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
13172024-11-22T20:31:29.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 138.645932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
13182024-11-22T20:31:29.718ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 45.754393477s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
13192024-11-22T20:31:29.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 103.923943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
13202024-11-22T20:31:29.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 86.907809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
13212024-11-22T20:31:29.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 122.752003ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
13222024-11-22T20:31:29.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 110.347559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
13232024-11-22T20:31:29.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 124.662524ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
13242024-11-22T20:31:29.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 69.289169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
13252024-11-22T20:31:29.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 118.819244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
13262024-11-22T20:31:29.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 241.986817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
13272024-11-22T20:31:29.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 135.067968ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
13282024-11-22T20:31:29.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 264.554136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
13292024-11-22T20:31:29.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 203.240988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
13302024-11-22T20:31:29.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 136.655778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
13312024-11-22T20:31:29.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 126.538115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
13322024-11-22T20:31:29.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 287.277472ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
13332024-11-22T20:31:29.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 142.318241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
13342024-11-22T20:31:29.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 150.220378ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
13352024-11-22T20:31:29.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 410.73181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
13362024-11-22T20:31:29.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 451.872879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
13372024-11-22T20:31:29.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 259.641175ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
13382024-11-22T20:31:30.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 441.235819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
13392024-11-22T20:31:30.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 277.545806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
13402024-11-22T20:31:30.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 290.435222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
13412024-11-22T20:31:30.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 313.033599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
13422024-11-22T20:31:30.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 472.196572ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
13432024-11-22T20:31:30.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 389.313266ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
13442024-11-22T20:31:30.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 353.993724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
13452024-11-22T20:31:30.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 548.778357ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
13462024-11-22T20:31:30.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 710.911693ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
13472024-11-22T20:31:30.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.117432929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
13482024-11-22T20:31:30.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 476.852319ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
13492024-11-22T20:31:30.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 639.29668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
13502024-11-22T20:31:30.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 849.916724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
13512024-11-22T20:31:30.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 435.435722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
13522024-11-22T20:31:30.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 547.373519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
13532024-11-22T20:31:30.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 995.319666ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
13542024-11-22T20:31:30.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 1.075642617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
13552024-11-22T20:31:30.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 680.537168ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
13562024-11-22T20:31:30.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.070916837s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
13572024-11-22T20:31:30.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 761.050895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
13582024-11-22T20:31:30.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 799.623793ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
13592024-11-22T20:31:30.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 883.825099ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
13602024-11-22T20:31:31.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 988.134216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
13612024-11-22T20:31:31.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.071775466s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
13622024-11-22T20:31:31.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 814.668993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
13632024-11-22T20:31:31.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.117648392s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
13642024-11-22T20:31:31.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.271922903s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
13652024-11-22T20:31:31.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 916.829699ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
13662024-11-22T20:31:31.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 924.819205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
13672024-11-22T20:31:31.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 589.065031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
13682024-11-22T20:31:31.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 911.12958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
13692024-11-22T20:31:31.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.46131637s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
13702024-11-22T20:31:31.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 715.474592ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
13712024-11-22T20:31:32.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 1.251057705s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
13722024-11-22T20:31:32.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.34859741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
13732024-11-22T20:31:32.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 677.831016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
13742024-11-22T20:31:32.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 766.752406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
13752024-11-22T20:31:32.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 603.742874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
13762024-11-22T20:31:32.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 612.335997ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
13772024-11-22T20:31:32.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 961.236123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
13782024-11-22T20:31:32.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.204330218s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
13792024-11-22T20:31:32.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 531.45375ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
13802024-11-22T20:31:32.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.482954454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
13812024-11-22T20:31:32.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.384933133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
13822024-11-22T20:31:32.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 690.978091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
13832024-11-22T20:31:33.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.182499525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
13842024-11-22T20:31:33.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 1.343969117s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
13852024-11-22T20:31:33.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 991.393444ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
13862024-11-22T20:31:33.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 1.099182623s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
13872024-11-22T20:31:33.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.484658367s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
13882024-11-22T20:31:33.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.475291904s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
13892024-11-22T20:31:33.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 905.876557ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
13902024-11-22T20:31:33.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 837.571727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
13912024-11-22T20:31:33.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 521.772366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
13922024-11-22T20:31:34.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.489394966s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
13932024-11-22T20:31:34.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.323958592s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
13942024-11-22T20:31:34.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 695.803557ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
13952024-11-22T20:31:34.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.158673916s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
13962024-11-22T20:31:34.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.157519944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
13972024-11-22T20:31:34.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 820.262213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
13982024-11-22T20:31:34.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 1.313117299s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
13992024-11-22T20:31:34.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 1.438524353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
14002024-11-22T20:31:34.470ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14012024-11-22T20:31:34.470ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14022024-11-22T20:31:34.470ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
14032024-11-22T20:31:34.476ZINFOSledAgent (ServiceManager): Booting oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
14042024-11-22T20:31:34.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 594.202267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
14052024-11-22T20:31:34.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 37.441813ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
14062024-11-22T20:31:34.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 73.821387ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
14072024-11-22T20:31:34.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 117.303504ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
14082024-11-22T20:31:34.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 87.027457ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
14092024-11-22T20:31:34.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.474558213s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
14102024-11-22T20:31:34.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 297.225941ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
14112024-11-22T20:31:34.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.324934767s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
14122024-11-22T20:31:34.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 184.66351ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
14132024-11-22T20:31:34.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 775.114648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
14142024-11-22T20:31:35.017ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14152024-11-22T20:31:35.028ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14162024-11-22T20:31:35.041ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='52ac2c0b-4a4d-47a0-9451-3c8356938264'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14172024-11-22T20:31:35.041ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_48b30200-6d9c-435a-8546-6c099d7abe31/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='66cbe764-5384-4480-adee-d6865cafeaed'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14182024-11-22T20:31:35.085ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
14192024-11-22T20:31:35.223ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
14202024-11-22T20:31:35.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 1.214280338s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
14212024-11-22T20:31:35.243ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
14222024-11-22T20:31:35.249ZINFOSledAgent (ServiceManager): Booting oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
14232024-11-22T20:31:35.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 522.510708ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
14242024-11-22T20:31:35.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 592.93614ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
14252024-11-22T20:31:35.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 1.365382061s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
14262024-11-22T20:31:35.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 857.483016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
14272024-11-22T20:31:35.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 68.366462ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
14282024-11-22T20:31:35.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 714.453962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
14292024-11-22T20:31:35.500ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14302024-11-22T20:31:35.500ZINFOSledAgent (ServiceManager): Booting oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
14312024-11-22T20:31:35.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.236875862s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
14322024-11-22T20:31:35.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 46.103232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
14332024-11-22T20:31:35.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 72.247709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
14342024-11-22T20:31:35.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 70.747555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
14352024-11-22T20:31:35.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 40.504584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
14362024-11-22T20:31:35.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 132.074021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
14372024-11-22T20:31:35.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 132.372123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
14382024-11-22T20:31:35.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.350719303s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
14392024-11-22T20:31:35.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 288.462328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
14402024-11-22T20:31:35.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 145.381038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
14412024-11-22T20:31:35.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 1.391037464s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
14422024-11-22T20:31:35.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 636.795612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
14432024-11-22T20:31:35.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 252.842214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
14442024-11-22T20:31:35.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 65.273715ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
14452024-11-22T20:31:35.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 218.733852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
14462024-11-22T20:31:35.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 860.834196ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
14472024-11-22T20:31:35.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 177.706694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
14482024-11-22T20:31:35.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 85.643068ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
14492024-11-22T20:31:35.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 1.458507474s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
14502024-11-22T20:31:35.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 542.206882ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
14512024-11-22T20:31:35.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 134.729104ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
14522024-11-22T20:31:35.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 293.570865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
14532024-11-22T20:31:36.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 505.44491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
14542024-11-22T20:31:36.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 333.18842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
14552024-11-22T20:31:36.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 254.140504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
14562024-11-22T20:31:36.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 454.407132ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
14572024-11-22T20:31:36.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.254163107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
14582024-11-22T20:31:36.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 543.033755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
14592024-11-22T20:31:36.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 665.817643ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
14602024-11-22T20:31:36.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 531.071081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
14612024-11-22T20:31:36.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.203550897s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
14622024-11-22T20:31:36.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 1.073576745s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
14632024-11-22T20:31:36.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 1.03925762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
14642024-11-22T20:31:36.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.126866966s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
14652024-11-22T20:31:36.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 1.318066728s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
14662024-11-22T20:31:36.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 1.265602763s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
14672024-11-22T20:31:36.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 527.906034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
14682024-11-22T20:31:36.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 1.054602454s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
14692024-11-22T20:31:36.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 1.2079539s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
14702024-11-22T20:31:36.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 1.279404533s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
14712024-11-22T20:31:36.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 787.079116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
14722024-11-22T20:31:36.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 1.088734298s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
14732024-11-22T20:31:36.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.234099968s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
14742024-11-22T20:31:36.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.198290589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
14752024-11-22T20:31:37.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.042683784s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
14762024-11-22T20:31:37.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 592.893834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
14772024-11-22T20:31:37.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 601.624912ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
14782024-11-22T20:31:37.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 814.504999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
14792024-11-22T20:31:37.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 751.116668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
14802024-11-22T20:31:37.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 1.46914808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
14812024-11-22T20:31:37.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.444656656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
14822024-11-22T20:31:37.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.25332202s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
14832024-11-22T20:31:37.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.211063474s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
14842024-11-22T20:31:37.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.387229518s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
14852024-11-22T20:31:37.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 1.449818751s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
14862024-11-22T20:31:37.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 1.426620814s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
14872024-11-22T20:31:37.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 586.405677ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
14882024-11-22T20:31:37.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 797.423033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
14892024-11-22T20:31:37.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 801.947776ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
14902024-11-22T20:31:37.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 521.812121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
14912024-11-22T20:31:37.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 790.846357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
14922024-11-22T20:31:37.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 813.201128ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
14932024-11-22T20:31:38.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.161748763s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
14942024-11-22T20:31:38.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.197737442s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
14952024-11-22T20:31:38.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 1.211013577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
14962024-11-22T20:31:38.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 592.096137ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
14972024-11-22T20:31:38.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 829.230979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
14982024-11-22T20:31:38.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 1.064998227s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
14992024-11-22T20:31:38.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 720.612073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
15002024-11-22T20:31:38.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 658.096256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
15012024-11-22T20:31:38.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 628.644541ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
15022024-11-22T20:31:38.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 1.239079149s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
15032024-11-22T20:31:38.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.14020961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
15042024-11-22T20:31:38.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 1.1402933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
15052024-11-22T20:31:38.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.308352783s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
15062024-11-22T20:31:38.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 1.144717501s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
15072024-11-22T20:31:38.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 655.580513ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
15082024-11-22T20:31:38.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.272516895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
15092024-11-22T20:31:38.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.386721558s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
15102024-11-22T20:31:39.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.46624271s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
15112024-11-22T20:31:39.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 533.163452ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
15122024-11-22T20:31:39.080ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15132024-11-22T20:31:39.084ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
15142024-11-22T20:31:39.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 1.04440455s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
15152024-11-22T20:31:39.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 811.046401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
15162024-11-22T20:31:39.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 1.169114805s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
15172024-11-22T20:31:39.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 883.826264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
15182024-11-22T20:31:39.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.014009353s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
15192024-11-22T20:31:39.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 41.143079ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
15202024-11-22T20:31:39.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.102955543s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
15212024-11-22T20:31:39.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 56.400504ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
15222024-11-22T20:31:39.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 1.383893156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
15232024-11-22T20:31:39.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 251.495329ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
15242024-11-22T20:31:39.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 695.607099ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
15252024-11-22T20:31:39.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 1.242983112s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
15262024-11-22T20:31:39.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 975.779494ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
15272024-11-22T20:31:39.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 279.807864ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
15282024-11-22T20:31:39.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.181759248s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
15292024-11-22T20:31:39.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 674.351236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
15302024-11-22T20:31:39.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 925.060488ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
15312024-11-22T20:31:39.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 978.2399ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
15322024-11-22T20:31:39.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 1.020218335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
15332024-11-22T20:31:39.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 773.327778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
15342024-11-22T20:31:40.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 788.4372ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
15352024-11-22T20:31:40.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 1.295681978s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
15362024-11-22T20:31:40.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 992.550199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
15372024-11-22T20:31:40.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 735.642588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
15382024-11-22T20:31:40.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 815.05545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
15392024-11-22T20:31:40.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 681.750567ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
15402024-11-22T20:31:40.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 971.548493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
15412024-11-22T20:31:40.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 791.266762ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
15422024-11-22T20:31:40.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 624.788641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
15432024-11-22T20:31:40.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.248189689s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
15442024-11-22T20:31:40.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 1.01681698s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
15452024-11-22T20:31:40.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 1.319005887s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
15462024-11-22T20:31:40.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 1.392008398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
15472024-11-22T20:31:40.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 1.013678767s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
15482024-11-22T20:31:40.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 1.274221457s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
15492024-11-22T20:31:40.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 1.028573043s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
15502024-11-22T20:31:40.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.024592469s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
15512024-11-22T20:31:40.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 845.302115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
15522024-11-22T20:31:40.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 810.72248ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
15532024-11-22T20:31:40.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.237672127s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
15542024-11-22T20:31:40.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 1.127273891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
15552024-11-22T20:31:41.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 980.725626ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
15562024-11-22T20:31:41.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 562.746066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
15572024-11-22T20:31:41.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 982.942253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
15582024-11-22T20:31:41.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 546.907589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
15592024-11-22T20:31:41.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 606.64066ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
15602024-11-22T20:31:41.210ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54057
15612024-11-22T20:31:41.226ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54057 req_id = fa3dd9ef-5dac-448c-a925-336dde69b4ed response_code = 200 uri = /baseboard
15622024-11-22T20:31:41.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.122534259s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
15632024-11-22T20:31:41.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 1.109913055s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
15642024-11-22T20:31:41.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 1.456209812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
15652024-11-22T20:31:41.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 779.85698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
15662024-11-22T20:31:41.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 1.232719687s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
15672024-11-22T20:31:41.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.130220041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
15682024-11-22T20:31:41.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 1.171381598s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
15692024-11-22T20:31:41.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 846.978791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
15702024-11-22T20:31:41.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 1.30192453s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
15712024-11-22T20:31:41.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 953.794405ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
15722024-11-22T20:31:41.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 710.23088ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
15732024-11-22T20:31:41.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 708.256934ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
15742024-11-22T20:31:41.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 1.436602342s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
15752024-11-22T20:31:42.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.317236393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
15762024-11-22T20:31:42.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.231246783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
15772024-11-22T20:31:42.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 1.404601471s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
15782024-11-22T20:31:42.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 832.597599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
15792024-11-22T20:31:42.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 738.769396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
15802024-11-22T20:31:42.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.053454178s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
15812024-11-22T20:31:42.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.435567449s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
15822024-11-22T20:31:42.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 944.201596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
15832024-11-22T20:31:42.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 734.362573ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
15842024-11-22T20:31:42.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 874.494089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
15852024-11-22T20:31:42.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 515.482976ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
15862024-11-22T20:31:42.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 536.763247ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
15872024-11-22T20:31:42.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 1.162527417s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
15882024-11-22T20:31:42.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.233413868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
15892024-11-22T20:31:42.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 818.157822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
15902024-11-22T20:31:42.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 732.427801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
15912024-11-22T20:31:42.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 977.010466ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
15922024-11-22T20:31:42.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 900.606514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
15932024-11-22T20:31:43.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 1.410702862s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
15942024-11-22T20:31:43.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 1.072139037s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
15952024-11-22T20:31:43.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 708.877793ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
15962024-11-22T20:31:43.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 658.433733ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
15972024-11-22T20:31:43.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 855.814156ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
15982024-11-22T20:31:43.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 1.411563599s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
15992024-11-22T20:31:43.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 879.208173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
16002024-11-22T20:31:43.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.188272508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
16012024-11-22T20:31:43.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 577.304488ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
16022024-11-22T20:31:43.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.079276303s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
16032024-11-22T20:31:43.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 1.356304541s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
16042024-11-22T20:31:43.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 1.166744867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
16052024-11-22T20:31:43.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 1.476531455s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
16062024-11-22T20:31:43.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 1.086033304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
16072024-11-22T20:31:43.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 748.086946ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
16082024-11-22T20:31:43.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.275911264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
16092024-11-22T20:31:43.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 1.262074252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
16102024-11-22T20:31:43.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 1.307494311s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
16112024-11-22T20:31:43.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 1.417900829s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
16122024-11-22T20:31:43.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 1.305538453s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
16132024-11-22T20:31:43.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 1.345828959s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
16142024-11-22T20:31:44.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 555.318294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
16152024-11-22T20:31:44.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 912.50585ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
16162024-11-22T20:31:44.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 634.047337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
16172024-11-22T20:31:44.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 680.127879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
16182024-11-22T20:31:44.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 1.030278319s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
16192024-11-22T20:31:44.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.419934431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
16202024-11-22T20:31:44.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 837.066123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
16212024-11-22T20:31:44.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.301126299s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
16222024-11-22T20:31:44.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 631.80494ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
16232024-11-22T20:31:44.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 713.793218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
16242024-11-22T20:31:44.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 1.052628012s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
16252024-11-22T20:31:44.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 1.200866647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
16262024-11-22T20:31:44.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 1.334120641s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
16272024-11-22T20:31:44.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 1.332354658s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
16282024-11-22T20:31:44.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.052393024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
16292024-11-22T20:31:45.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.045406734s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
16302024-11-22T20:31:45.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 535.991565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
16312024-11-22T20:31:45.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 1.296575891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
16322024-11-22T20:31:45.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.071679065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
16332024-11-22T20:31:45.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 763.295178ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
16342024-11-22T20:31:45.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 930.679055ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
16352024-11-22T20:31:45.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 1.107002351s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
16362024-11-22T20:31:45.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.124685085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
16372024-11-22T20:31:45.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 735.385356ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
16382024-11-22T20:31:45.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 975.319209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
16392024-11-22T20:31:45.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.460025673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
16402024-11-22T20:31:45.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 841.936393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
16412024-11-22T20:31:45.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 603.238216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
16422024-11-22T20:31:45.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 1.408463817s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
16432024-11-22T20:31:45.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.12913698s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
16442024-11-22T20:31:45.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 966.137191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
16452024-11-22T20:31:45.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.052128721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
16462024-11-22T20:31:46.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 824.181176ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
16472024-11-22T20:31:46.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 1.403920076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
16482024-11-22T20:31:46.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 786.674957ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
16492024-11-22T20:31:46.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 624.230013ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
16502024-11-22T20:31:46.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 932.159006ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
16512024-11-22T20:31:46.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 975.444651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
16522024-11-22T20:31:46.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 1.247691862s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
16532024-11-22T20:31:46.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 853.668369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
16542024-11-22T20:31:46.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 1.410005409s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
16552024-11-22T20:31:46.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 608.39401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
16562024-11-22T20:31:46.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 1.381381444s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
16572024-11-22T20:31:46.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 1.122417596s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
16582024-11-22T20:31:46.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 655.627252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
16592024-11-22T20:31:46.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.394740919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
16602024-11-22T20:31:46.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 589.873029ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
16612024-11-22T20:31:46.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 1.286068829s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
16622024-11-22T20:31:46.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.049546503s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
16632024-11-22T20:31:46.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 626.60915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
16642024-11-22T20:31:46.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.34974844s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
16652024-11-22T20:31:47.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 695.282485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
16662024-11-22T20:31:47.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 503.986227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
16672024-11-22T20:31:47.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 899.671849ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
16682024-11-22T20:31:47.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.156881939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
16692024-11-22T20:31:47.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 837.466005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
16702024-11-22T20:31:47.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 1.334063216s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
16712024-11-22T20:31:47.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 1.128611887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
16722024-11-22T20:31:47.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66") failed: Property not found. retry in 1.119569067s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
16732024-11-22T20:31:47.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 1.295977717s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
16742024-11-22T20:31:47.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 939.236213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
16752024-11-22T20:31:47.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 723.296984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
16762024-11-22T20:31:47.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.384480561s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
16772024-11-22T20:31:47.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 855.372209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
16782024-11-22T20:31:47.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 896.533367ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
16792024-11-22T20:31:47.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 1.082753224s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
16802024-11-22T20:31:47.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 869.556846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
16812024-11-22T20:31:47.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 929.955644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
16822024-11-22T20:31:47.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.265913207s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
16832024-11-22T20:31:48.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 863.310087ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
16842024-11-22T20:31:48.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 1.229431763s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
16852024-11-22T20:31:48.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 590.90726ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
16862024-11-22T20:31:48.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 752.902773ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
16872024-11-22T20:31:48.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 1.276601602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
16882024-11-22T20:31:48.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 545.249155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
16892024-11-22T20:31:48.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 1.409235216s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
16902024-11-22T20:31:48.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 1.3764045s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
16912024-11-22T20:31:48.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5") failed: Property not found. retry in 1.315552149s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
16922024-11-22T20:31:48.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f") failed: Property not found. retry in 1.400566526s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
16932024-11-22T20:31:48.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 612.193632ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
16942024-11-22T20:31:48.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 1.000053558s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
16952024-11-22T20:31:48.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.167311129s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
16962024-11-22T20:31:48.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 1.351997563s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
16972024-11-22T20:31:48.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693") failed: Property not found. retry in 890.765659ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
16982024-11-22T20:31:48.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 792.733816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
16992024-11-22T20:31:48.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec") failed: Property not found. retry in 932.725136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
17002024-11-22T20:31:48.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.429880773s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
17012024-11-22T20:31:48.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 786.12573ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
17022024-11-22T20:31:48.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 693.533352ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
17032024-11-22T20:31:48.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 654.861827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
17042024-11-22T20:31:49.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817") failed: Property not found. retry in 1.481697736s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
17052024-11-22T20:31:49.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 1.028236832s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
17062024-11-22T20:31:49.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 820.447091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
17072024-11-22T20:31:49.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90") failed: Property not found. retry in 1.159937768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
17082024-11-22T20:31:49.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37") failed: Property not found. retry in 1.170096811s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
17092024-11-22T20:31:49.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 676.341631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
17102024-11-22T20:31:49.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 1.314225769s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
17112024-11-22T20:31:49.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b") failed: Property not found. retry in 1.111968244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
17122024-11-22T20:31:49.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 635.282083ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
17132024-11-22T20:31:49.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5") failed: Property not found. retry in 1.091277653s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
17142024-11-22T20:31:49.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85") failed: Property not found. retry in 936.943727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
17152024-11-22T20:31:49.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829") failed: Property not found. retry in 1.202048493s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
17162024-11-22T20:31:50.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464") failed: Property not found. retry in 1.12228775s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
17172024-11-22T20:31:50.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57") failed: Property not found. retry in 877.680577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
17182024-11-22T20:31:50.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1") failed: Property not found. retry in 733.778947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
17192024-11-22T20:31:50.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73") failed: Property not found. retry in 1.287484213s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
17202024-11-22T20:31:50.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0") failed: Property not found. retry in 1.012832531s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
17212024-11-22T20:31:50.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4") failed: Property not found. retry in 1.003670237s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
17222024-11-22T20:31:50.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 704.812279ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
17232024-11-22T20:31:51.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647") failed: Property not found. retry in 810.024159ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
17242024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_0b445703-3f22-4947-b740-b6fa5cd0ad57
17252024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_2bc22f8c-738b-408c-b709-f243d852ede1
17262024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_e41eaf1d-bd79-475b-9a28-760154bc92c0
17272024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_629b0356-ba24-4504-89b1-926bdda66829
17282024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_7bfceb24-d461-40ce-8d0a-00e78380ff73
17292024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_d9c2b42c-283d-4702-a1b3-9e7aa661833f
17302024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_9e5c0409-067b-4d34-9125-c0f4499eea37
17312024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_75de5901-fe9a-4840-8d2c-e4fcf3ab3f90
17322024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_42916f4f-edf0-4dc5-9846-22e69c4ae5d5
17332024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_267c9b78-f350-4c38-8b20-14a41a3c0693
17342024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_e9915dd1-a3eb-4eda-8383-a5528e4ab817
17352024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_53d5de21-8a53-47fc-905a-307592526d1b
17362024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_fb1e901a-bcca-493f-ba36-e82914f0ffc4
17372024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_3427952d-8b90-4d58-8b73-11761ced1464
17382024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_clickhouse_f1423f48-486c-47b1-8bb5-aa7fe40d2647
17392024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_oximeter_1c039189-a5ba-4d68-ace9-448d7d9a3f66
17402024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_66fea123-b70e-478e-b3c1-a949874739b5
17412024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_34169942-b5d1-4d61-8c71-79c36302c9ec
17422024-11-22T20:31:52.542ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_d0321183-a49c-4480-b2c7-d268c37c9e85
17432024-11-22T20:31:52.548ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
17442024-11-22T20:31:52.550ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json"
17452024-11-22T20:31:52.550ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
17462024-11-22T20:31:52.553ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json"
17472024-11-22T20:31:52.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42066810 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64553 req_id = 7e079023-2294-4340-8008-e9d863f66102 response_code = 204 uri = /omicron-zones
17482024-11-22T20:31:52.579ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
17492024-11-22T20:31:52.579ZINFOSledAgent (RSS): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
17502024-11-22T20:31:52.579ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/rss-plan-completed.marker"
17512024-11-22T20:31:52.579ZINFOSledAgent (RSS): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
17522024-11-22T20:31:52.579ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/rss-plan-completed.marker"
17532024-11-22T20:31:52.596ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
17542024-11-22T20:31:52.598ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
17552024-11-22T20:31:52.656ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
17562024-11-22T20:31:52.660ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17572024-11-22T20:31:52.752ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17582024-11-22T20:31:52.824ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17592024-11-22T20:31:52.971ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17602024-11-22T20:31:53.163ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17612024-11-22T20:31:53.334ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17622024-11-22T20:31:53.499ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/nexus.rs:527 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
17632024-11-22T20:31:53.499ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
17642024-11-22T20:31:53.586ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17652024-11-22T20:31:53.852ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/nexus.rs:527 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
17662024-11-22T20:31:53.871ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17672024-11-22T20:31:54.313ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17682024-11-22T20:31:54.504ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
17692024-11-22T20:31:54.834ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17702024-11-22T20:31:55.279ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17712024-11-22T20:31:55.506ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/probe_manager.rs:231 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
17722024-11-22T20:31:55.590ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8dcc32b6-a955-403f-b8f5-2d130f25dc49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17732024-11-22T20:31:55.845ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/714aeaa4-2ee3-4359-b59d-b4bb953043b4) file = sled-agent/src/nexus.rs:527 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
17742024-11-22T20:31:56.847ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f37d7040-9893-4bab-bae0-7ff538275e53", "content-length": "173", "date": "Fri, 22 Nov 2024 20:31:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8dcc32b6-a955-403f-b8f5-2d130f25dc49\"", request_id: "f37d7040-9893-4bab-bae0-7ff538275e53" } file = sled-agent/src/rack_setup/service.rs:1075
17752024-11-22T20:31:57.567ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "88ad307b-c55a-4e65-bfb2-83c6de9da162", "content-length": "173", "date": "Fri, 22 Nov 2024 20:31:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8dcc32b6-a955-403f-b8f5-2d130f25dc49\"", request_id: "88ad307b-c55a-4e65-bfb2-83c6de9da162" } file = sled-agent/src/rack_setup/service.rs:1075
17762024-11-22T20:31:58.251ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f42e7e7a-bac1-43eb-a9bc-74e1b43e8156", "content-length": "173", "date": "Fri, 22 Nov 2024 20:31:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8dcc32b6-a955-403f-b8f5-2d130f25dc49\"", request_id: "f42e7e7a-bac1-43eb-a9bc-74e1b43e8156" } file = sled-agent/src/rack_setup/service.rs:1075
17772024-11-22T20:31:59.980ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
17782024-11-22T20:32:00.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64132
17792024-11-22T20:32:00.040ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17802024-11-22T20:32:00.040ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17812024-11-22T20:32:00.040ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:178
17822024-11-22T20:32:00.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45609
17832024-11-22T20:32:00.040ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17842024-11-22T20:32:00.044ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:178
17852024-11-22T20:32:00.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44253
17862024-11-22T20:32:00.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44253 req_id = 810ffcd1-ba21-45fa-a57c-68c561ab2b06 response_code = 200 uri = /v2p
17872024-11-22T20:32:00.061ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17882024-11-22T20:32:00.061ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451
17892024-11-22T20:32:00.081ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17902024-11-22T20:32:00.081ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:178
17912024-11-22T20:32:00.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42860
17922024-11-22T20:32:00.086ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:178
17932024-11-22T20:32:00.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42860 req_id = 388988a3-dde8-4d10-a0dc-3ff7f9b2de91 response_code = 200 uri = /v2p
17942024-11-22T20:32:00.094ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17952024-11-22T20:32:00.094ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8c870c6a-53aa-40e3-8b74-681d946263cd
17962024-11-22T20:32:00.113ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17972024-11-22T20:32:00.113ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451
17982024-11-22T20:32:00.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61389
17992024-11-22T20:32:00.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 437 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61389 req_id = 4867dc4c-b859-47b8-9ef6-ff99f48a52af response_code = 200 uri = /v2p
18002024-11-22T20:32:00.146ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18012024-11-22T20:32:00.146ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8c870c6a-53aa-40e3-8b74-681d946263cd
18022024-11-22T20:32:00.164ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18032024-11-22T20:32:00.164ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26
18042024-11-22T20:32:00.184ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18052024-11-22T20:32:00.184ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26
18062024-11-22T20:32:00.206ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18072024-11-22T20:32:00.206ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e83de9a9-73fc-4157-8f0d-bc628401b262
18082024-11-22T20:32:00.224ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18092024-11-22T20:32:00.224ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e83de9a9-73fc-4157-8f0d-bc628401b262
18102024-11-22T20:32:00.241ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18112024-11-22T20:32:00.241ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6192e0c0-75f6-422c-9444-5c281ce64c40
18122024-11-22T20:32:00.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51574
18132024-11-22T20:32:00.256ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18142024-11-22T20:32:00.256ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18152024-11-22T20:32:00.256ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18162024-11-22T20:32:00.256ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6192e0c0-75f6-422c-9444-5c281ce64c40
18172024-11-22T20:32:00.256ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:178
18182024-11-22T20:32:00.263ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:178
18192024-11-22T20:32:00.275ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18202024-11-22T20:32:00.275ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b30200-6d9c-435a-8546-6c099d7abe31
18212024-11-22T20:32:00.293ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18222024-11-22T20:32:00.293ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451
18232024-11-22T20:32:00.308ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18242024-11-22T20:32:00.308ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b30200-6d9c-435a-8546-6c099d7abe31
18252024-11-22T20:32:00.321ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18262024-11-22T20:32:00.321ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1
18272024-11-22T20:32:00.336ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18282024-11-22T20:32:00.336ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8c870c6a-53aa-40e3-8b74-681d946263cd
18292024-11-22T20:32:00.351ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18302024-11-22T20:32:00.351ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1
18312024-11-22T20:32:00.365ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18322024-11-22T20:32:00.365ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f
18332024-11-22T20:32:00.378ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18342024-11-22T20:32:00.378ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26
18352024-11-22T20:32:00.397ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18362024-11-22T20:32:00.397ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f
18372024-11-22T20:32:00.410ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18382024-11-22T20:32:00.410ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_04456916-263d-47e8-84ad-1a50c9bd09d7
18392024-11-22T20:32:00.425ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18402024-11-22T20:32:00.425ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e83de9a9-73fc-4157-8f0d-bc628401b262
18412024-11-22T20:32:00.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 396010 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64132 req_id = 5994a4bf-d565-4b13-bebe-5f26ed916ea0 response_code = 200 uri = /inventory
18422024-11-22T20:32:00.440ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18432024-11-22T20:32:00.440ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_04456916-263d-47e8-84ad-1a50c9bd09d7
18442024-11-22T20:32:00.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 414308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45609 req_id = d243e962-75e0-444a-b626-b0fa4d40caae response_code = 200 uri = /inventory
18452024-11-22T20:32:00.455ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18462024-11-22T20:32:00.455ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6192e0c0-75f6-422c-9444-5c281ce64c40
18472024-11-22T20:32:00.480ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18482024-11-22T20:32:00.480ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b30200-6d9c-435a-8546-6c099d7abe31
18492024-11-22T20:32:00.503ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18502024-11-22T20:32:00.503ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1
18512024-11-22T20:32:00.529ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18522024-11-22T20:32:00.529ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f
18532024-11-22T20:32:00.562ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18542024-11-22T20:32:00.562ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_04456916-263d-47e8-84ad-1a50c9bd09d7
18552024-11-22T20:32:00.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333006 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51574 req_id = 069e7e5c-8336-4bfe-9f4d-5c3b7845cec6 response_code = 200 uri = /inventory
18562024-11-22T20:32:01.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36728
18572024-11-22T20:32:01.586ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18582024-11-22T20:32:01.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18592024-11-22T20:32:01.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18602024-11-22T20:32:01.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18612024-11-22T20:32:01.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18622024-11-22T20:32:01.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18632024-11-22T20:32:01.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18642024-11-22T20:32:01.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36728 req_id = 53a68b0d-9d79-4c23-9aab-95699ebc2fee response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18652024-11-22T20:32:01.588ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
18662024-11-22T20:32:01.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60202
18672024-11-22T20:32:01.834ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18682024-11-22T20:32:01.834ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18692024-11-22T20:32:01.834ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:178
18702024-11-22T20:32:01.834ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:178
18712024-11-22T20:32:01.845ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18722024-11-22T20:32:01.845ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451
18732024-11-22T20:32:01.869ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18742024-11-22T20:32:01.869ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8c870c6a-53aa-40e3-8b74-681d946263cd
18752024-11-22T20:32:01.892ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18762024-11-22T20:32:01.892ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26
18772024-11-22T20:32:01.916ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18782024-11-22T20:32:01.916ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e83de9a9-73fc-4157-8f0d-bc628401b262
18792024-11-22T20:32:01.938ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18802024-11-22T20:32:01.938ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6192e0c0-75f6-422c-9444-5c281ce64c40
18812024-11-22T20:32:01.960ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18822024-11-22T20:32:01.960ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b30200-6d9c-435a-8546-6c099d7abe31
18832024-11-22T20:32:01.985ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18842024-11-22T20:32:01.985ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1
18852024-11-22T20:32:02.008ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18862024-11-22T20:32:02.008ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f
18872024-11-22T20:32:02.031ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18882024-11-22T20:32:02.031ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_04456916-263d-47e8-84ad-1a50c9bd09d7
18892024-11-22T20:32:02.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60202 req_id = 4cddbd9c-3c43-4067-9ea9-7c4be88d2629 response_code = 200 uri = /inventory
18902024-11-22T20:32:02.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46398
18912024-11-22T20:32:02.351ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18922024-11-22T20:32:02.351ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18932024-11-22T20:32:02.351ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18942024-11-22T20:32:02.351ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18952024-11-22T20:32:02.351ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18962024-11-22T20:32:02.351ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18972024-11-22T20:32:02.351ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18982024-11-22T20:32:02.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46398 req_id = 88042225-806e-46a6-bdf8-db53e67ab58d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18992024-11-22T20:32:02.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52416
19002024-11-22T20:32:02.445ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19012024-11-22T20:32:02.445ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19022024-11-22T20:32:02.445ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19032024-11-22T20:32:02.445ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19042024-11-22T20:32:02.445ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19052024-11-22T20:32:02.445ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19062024-11-22T20:32:02.445ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19072024-11-22T20:32:02.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 423 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52416 req_id = 12f2a57f-f466-4eea-aec3-32cc7c38c10c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19082024-11-22T20:32:02.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56209
19092024-11-22T20:32:02.830ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19102024-11-22T20:32:02.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19112024-11-22T20:32:02.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19122024-11-22T20:32:02.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19132024-11-22T20:32:02.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19142024-11-22T20:32:02.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19152024-11-22T20:32:02.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19162024-11-22T20:32:02.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 858 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56209 req_id = 5c4f28e1-b436-4064-8ff2-ccac9fb5fbc1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19172024-11-22T20:32:07.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34739
19182024-11-22T20:32:07.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1399 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34739 req_id = 8e79b88b-65d9-441d-9d26-e52d0e539a9e response_code = 200 uri = /vpc-routes
19192024-11-22T20:32:07.665ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
19202024-11-22T20:32:07.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34739 req_id = 22cf2a1b-c2ee-4e72-8caf-31bf120e749d response_code = 204 uri = /eip-gateways
19212024-11-22T20:32:07.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2869 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34739 req_id = 3e4b243a-17bb-4350-810a-12abb4a0d8c1 response_code = 204 uri = /vpc-routes
19222024-11-22T20:32:11.268ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59875
19232024-11-22T20:32:11.268ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59875 req_id = 7e9cb370-a2b6-4f7c-9e11-c40a981d53d4 response_code = 200 uri = /baseboard
19242024-11-22T20:32:26.532ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:57404 remote_addr = [fd00:1122:3344:101::d]:36383 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
19252024-11-22T20:32:26.555ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22387 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 910e268c-9750-41ed-8213-ca13bc93f28b response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
19262024-11-22T20:32:29.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45211
19272024-11-22T20:32:29.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45211 req_id = 6a20a517-9ace-4613-90c0-f28aba675734 response_code = 200 uri = /vpc-routes
19282024-11-22T20:32:29.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44160
19292024-11-22T20:32:29.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44160 req_id = e3499039-527d-4998-be15-c7c8010d81ab response_code = 200 uri = /vpc-routes
19302024-11-22T20:32:29.831ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
19312024-11-22T20:32:29.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45211 req_id = f316126c-78ab-4c28-9f33-497056e31f1b response_code = 204 uri = /eip-gateways
19322024-11-22T20:32:29.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45211 req_id = 1edcb18b-a078-43c3-a5b8-fb0245c5d24d response_code = 204 uri = /vpc-routes
19332024-11-22T20:32:29.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
19342024-11-22T20:32:29.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44160 req_id = 3174a28d-4b2e-4ae9-91bc-c1d8f377af65 response_code = 204 uri = /eip-gateways
19352024-11-22T20:32:29.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55765
19362024-11-22T20:32:29.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55765 req_id = 881ef4f3-de2b-45cb-bb61-83875dc4ead7 response_code = 200 uri = /v2p
19372024-11-22T20:32:29.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44160 req_id = 96bbae88-b927-4f08-ba0c-144f59a88d1d response_code = 204 uri = /vpc-routes
19382024-11-22T20:32:29.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62947
19392024-11-22T20:32:29.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19402024-11-22T20:32:30.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19412024-11-22T20:32:30.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138819 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62947 req_id = 6515ab8e-9e38-4a4b-a99a-3fa742732bd8 response_code = 204 uri = /switch-ports
19422024-11-22T20:32:30.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57634
19432024-11-22T20:32:30.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47049
19442024-11-22T20:32:30.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63523
19452024-11-22T20:32:30.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43799
19462024-11-22T20:32:30.099ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19472024-11-22T20:32:30.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63523 req_id = da7888f0-853c-4144-9b7d-452ee17a8a80 response_code = 200 uri = /vpc-routes
19482024-11-22T20:32:30.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57634 req_id = 849570c4-b27a-48d2-8a5d-a737b626b64b response_code = 200 uri = /v2p
19492024-11-22T20:32:30.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62947 req_id = ea2fd8b0-f09e-4d28-8845-ec473c02f10f response_code = 200 uri = /network-bootstore-config
19502024-11-22T20:32:30.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48971
19512024-11-22T20:32:30.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48971 req_id = 68a8490f-f2e8-498d-8f81-8b846c7640a2 response_code = 200 uri = /v2p
19522024-11-22T20:32:30.143ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19532024-11-22T20:32:30.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
19542024-11-22T20:32:30.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63523 req_id = 3e5cb24e-e9a4-41c2-a5a5-bf9300d071f7 response_code = 204 uri = /eip-gateways
19552024-11-22T20:32:30.173ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
19562024-11-22T20:32:30.173ZINFOSledAgent (bootstore): Writing ledger to /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-sock-i86pc
19572024-11-22T20:32:30.179ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/cluster/bootstore-network-config.json" peer_id = pc-sock-i86pc
19582024-11-22T20:32:30.179ZINFOSledAgent (bootstore): Writing ledger to /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-sock-i86pc
19592024-11-22T20:32:30.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1349 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63523 req_id = 32ff95a0-b1a0-411b-8ae2-669ddb612e7f response_code = 204 uri = /vpc-routes
19602024-11-22T20:32:30.181ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/cluster/bootstore-network-config.json" peer_id = pc-sock-i86pc
19612024-11-22T20:32:30.181ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
19622024-11-22T20:32:30.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9875 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62947 req_id = b2831637-07dd-4d8f-a351-8623013b56c4 response_code = 204 uri = /network-bootstore-config
19632024-11-22T20:32:30.216ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19642024-11-22T20:32:30.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116539 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43799 req_id = 2e53d7f1-2bc8-4d15-a207-6aed3f65cf19 response_code = 204 uri = /switch-ports
19652024-11-22T20:32:30.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 741 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43799 req_id = eb737382-dc9e-412f-bf83-70f65d61d040 response_code = 200 uri = /network-bootstore-config
19662024-11-22T20:32:30.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19672024-11-22T20:32:30.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47049 req_id = 47aca4cd-48f3-411c-8998-dcb62d029daf response_code = 204 uri = /switch-ports
19682024-11-22T20:32:30.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47049 req_id = d725f279-a9b7-45bf-8447-955b2eec9e3c response_code = 200 uri = /network-bootstore-config
19692024-11-22T20:32:34.874ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19702024-11-22T20:32:41.304ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63459
19712024-11-22T20:32:41.304ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63459 req_id = b3cd80c2-791c-46c0-8810-1903b73a599b response_code = 200 uri = /baseboard
19722024-11-22T20:32:56.428ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7756 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = c423aae6-31a6-43fb-89d9-88a0ec9fca46 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
19732024-11-22T20:32:59.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65163
19742024-11-22T20:32:59.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65163 req_id = d1ea563c-af67-4b01-94a6-a6cc12e64686 response_code = 200 uri = /vpc-routes
19752024-11-22T20:32:59.803ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
19762024-11-22T20:32:59.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65163 req_id = c93a19a1-d5f9-486f-a952-af2fcbdeb1b0 response_code = 204 uri = /eip-gateways
19772024-11-22T20:32:59.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65163 req_id = 0999e9de-fc98-4a22-a291-529ab98fe189 response_code = 204 uri = /vpc-routes
19782024-11-22T20:32:59.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36944
19792024-11-22T20:32:59.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36944 req_id = bcc9035d-84dd-4519-b93f-31942300fac7 response_code = 200 uri = /vpc-routes
19802024-11-22T20:32:59.894ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
19812024-11-22T20:32:59.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36944 req_id = 2d840ad3-3d62-4c5d-94d0-a4a1b3087ddb response_code = 204 uri = /eip-gateways
19822024-11-22T20:32:59.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36432
19832024-11-22T20:32:59.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36432 req_id = d3271e12-62b5-4427-9118-094f53108e5f response_code = 200 uri = /v2p
19842024-11-22T20:32:59.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42439
19852024-11-22T20:32:59.942ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19862024-11-22T20:32:59.984ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19872024-11-22T20:33:00.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105390 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42439 req_id = 8e560dd4-17ff-4b0b-9e06-4f7005b3e2a3 response_code = 204 uri = /switch-ports
19882024-11-22T20:33:00.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60223
19892024-11-22T20:33:00.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64350
19902024-11-22T20:33:00.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42439 req_id = f44a974f-7b02-4109-97ca-1c0c2f8cff12 response_code = 200 uri = /network-bootstore-config
19912024-11-22T20:33:00.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60223 req_id = 914cdb56-438a-4610-bcfa-a8eef2d741e1 response_code = 200 uri = /vpc-routes
19922024-11-22T20:33:00.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64350 req_id = 0fcbc2c3-b683-4b95-a040-36609cc24c73 response_code = 200 uri = /v2p
19932024-11-22T20:33:00.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36944 req_id = aed2d42a-70ac-4345-97ff-7014fe561f20 response_code = 204 uri = /vpc-routes
19942024-11-22T20:33:00.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64048
19952024-11-22T20:33:00.057ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19962024-11-22T20:33:00.095ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19972024-11-22T20:33:00.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64048 req_id = 89d5a88e-c3dc-4bba-9ca1-5392d4d5390b response_code = 204 uri = /switch-ports
19982024-11-22T20:33:00.153ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
19992024-11-22T20:33:00.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60223 req_id = 0e74d0c5-b6b5-47ab-a325-83759317230c response_code = 204 uri = /eip-gateways
20002024-11-22T20:33:00.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64048 req_id = a1d7dc07-ab8a-4c7f-a15b-9531ec7be811 response_code = 200 uri = /network-bootstore-config
20012024-11-22T20:33:00.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43917
20022024-11-22T20:33:00.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43917 req_id = 0dbd593b-f802-4cbf-8725-3c602aaabd15 response_code = 200 uri = /v2p
20032024-11-22T20:33:00.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60223 req_id = 7e4528d6-1f66-4161-93fc-9e64ef6f2204 response_code = 204 uri = /vpc-routes
20042024-11-22T20:33:00.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50672
20052024-11-22T20:33:00.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20062024-11-22T20:33:00.225ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20072024-11-22T20:33:00.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91489 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50672 req_id = af39534e-2897-46d9-b57a-84b7221668f3 response_code = 204 uri = /switch-ports
20082024-11-22T20:33:00.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50672 req_id = c5fa2b8f-4612-4ccb-b92c-692cf9a5df81 response_code = 200 uri = /network-bootstore-config
20092024-11-22T20:33:11.337ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50128
20102024-11-22T20:33:11.337ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50128 req_id = 3f6158b4-5d52-43b9-9252-d7fd326f1fa7 response_code = 200 uri = /baseboard
20112024-11-22T20:33:26.397ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5884 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 9b42c04a-ea43-4140-a72a-dc2de85ab283 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
20122024-11-22T20:33:29.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57261
20132024-11-22T20:33:29.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57261 req_id = 17ba8bc2-974e-49c8-a6f1-9716eef54029 response_code = 200 uri = /vpc-routes
20142024-11-22T20:33:29.622ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
20152024-11-22T20:33:29.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57261 req_id = 27f32866-9995-4574-b928-62d4f4b996d2 response_code = 204 uri = /eip-gateways
20162024-11-22T20:33:29.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46952
20172024-11-22T20:33:29.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46952 req_id = 45bb6043-a3d4-4c5b-9705-8f55bee897d6 response_code = 200 uri = /v2p
20182024-11-22T20:33:29.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57261 req_id = 77965cbe-81c0-4437-9f84-9728d34ed810 response_code = 204 uri = /vpc-routes
20192024-11-22T20:33:29.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35226
20202024-11-22T20:33:29.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20212024-11-22T20:33:29.785ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20222024-11-22T20:33:29.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99669 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35226 req_id = ae309635-9494-4a1a-8279-1ec3532f048c response_code = 204 uri = /switch-ports
20232024-11-22T20:33:29.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35226 req_id = 3dceacde-9333-4609-ba55-eac3d6b07355 response_code = 200 uri = /network-bootstore-config
20242024-11-22T20:33:29.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61310
20252024-11-22T20:33:29.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61310 req_id = 76a1e9eb-2283-41c6-9b70-c3801dacb7ab response_code = 200 uri = /vpc-routes
20262024-11-22T20:33:29.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57898
20272024-11-22T20:33:29.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57898 req_id = 9ae6aac5-1088-452c-b770-c4903e42bfc1 response_code = 200 uri = /v2p
20282024-11-22T20:33:29.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52256
20292024-11-22T20:33:29.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52256 req_id = a0acda91-a0d4-4c59-ac86-dbad6efcc0c9 response_code = 200 uri = /vpc-routes
20302024-11-22T20:33:29.907ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
20312024-11-22T20:33:29.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61310 req_id = 7c7f50d0-cffb-4e2b-892f-dfea601b6d7b response_code = 204 uri = /eip-gateways
20322024-11-22T20:33:29.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61310 req_id = 0b2b5c35-4b73-4cde-850d-195b03a94b95 response_code = 204 uri = /vpc-routes
20332024-11-22T20:33:29.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36805
20342024-11-22T20:33:29.923ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20352024-11-22T20:33:29.962ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20362024-11-22T20:33:30.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98348 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36805 req_id = 8d422e80-5291-481a-a226-67b53239b1cd response_code = 204 uri = /switch-ports
20372024-11-22T20:33:30.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42299
20382024-11-22T20:33:30.021ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
20392024-11-22T20:33:30.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52256 req_id = db7259db-afc8-44ce-a15b-a6a938d4a05e response_code = 204 uri = /eip-gateways
20402024-11-22T20:33:30.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36805 req_id = bb8367eb-60df-4720-911d-c0e9e3b6cce2 response_code = 200 uri = /network-bootstore-config
20412024-11-22T20:33:30.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42299 req_id = 2e1439ec-e26c-412a-8440-b375d2cf5a02 response_code = 200 uri = /v2p
20422024-11-22T20:33:30.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52256 req_id = b65d2f67-c541-48c5-b72a-51185ab001c7 response_code = 204 uri = /vpc-routes
20432024-11-22T20:33:30.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47240
20442024-11-22T20:33:30.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20452024-11-22T20:33:30.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20462024-11-22T20:33:30.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89481 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47240 req_id = 90705bd5-a8c0-4aed-b7ab-040b53a4b842 response_code = 204 uri = /switch-ports
20472024-11-22T20:33:30.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47240 req_id = ce4b6ad7-afd1-4aae-8333-cc0f42f9fe39 response_code = 200 uri = /network-bootstore-config
20482024-11-22T20:33:41.372ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59198
20492024-11-22T20:33:41.372ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59198 req_id = 527d83fc-9318-4992-8349-3dbcd477ee67 response_code = 200 uri = /baseboard
20502024-11-22T20:33:56.400ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8719 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 2f136802-b353-4c98-8d42-d99828777ca0 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
20512024-11-22T20:33:59.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56936
20522024-11-22T20:33:59.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56936 req_id = 55cbf559-349d-481e-b0fc-5617d973a01b response_code = 200 uri = /vpc-routes
20532024-11-22T20:33:59.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59686
20542024-11-22T20:33:59.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59686 req_id = 6eaa4472-f787-4005-8469-a4cef5c471d5 response_code = 200 uri = /vpc-routes
20552024-11-22T20:33:59.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
20562024-11-22T20:33:59.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 626 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56936 req_id = 6c9730ca-ef8f-4f17-bff8-2f594874e830 response_code = 204 uri = /eip-gateways
20572024-11-22T20:33:59.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56936 req_id = f39ed225-43f6-4fe9-8e4e-163be6405ddd response_code = 204 uri = /vpc-routes
20582024-11-22T20:33:59.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
20592024-11-22T20:33:59.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59686 req_id = 390092e9-21b7-4985-8894-4ca68a73ba86 response_code = 204 uri = /eip-gateways
20602024-11-22T20:33:59.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57195
20612024-11-22T20:33:59.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57195 req_id = c11462e4-77a1-41a5-be31-5ebc66e2377e response_code = 200 uri = /v2p
20622024-11-22T20:33:59.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37555
20632024-11-22T20:33:59.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37555 req_id = 82586c9e-6e84-497a-8c74-b8f926d661b0 response_code = 200 uri = /vpc-routes
20642024-11-22T20:33:59.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43279
20652024-11-22T20:33:59.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43279 req_id = eb34138f-12ce-4bf3-a0df-cec75013c368 response_code = 200 uri = /v2p
20662024-11-22T20:33:59.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59686 req_id = ba80799f-ae9d-415d-b6fd-c7225eb5556f response_code = 204 uri = /vpc-routes
20672024-11-22T20:34:00.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43012
20682024-11-22T20:34:00.004ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20692024-11-22T20:34:00.048ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20702024-11-22T20:34:00.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104546 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43012 req_id = ba76817b-9aaf-4291-be2b-13d5a5268f51 response_code = 204 uri = /switch-ports
20712024-11-22T20:34:00.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50612
20722024-11-22T20:34:00.109ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
20732024-11-22T20:34:00.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37555 req_id = b651cca9-360d-4aaa-8e9b-d30d3577a9d4 response_code = 204 uri = /eip-gateways
20742024-11-22T20:34:00.109ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20752024-11-22T20:34:00.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43012 req_id = 72bcbd75-b829-4a11-9348-5c95bc696c91 response_code = 200 uri = /network-bootstore-config
20762024-11-22T20:34:00.142ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20772024-11-22T20:34:00.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85064 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50612 req_id = 0fc5772a-b836-4b81-834b-4d2df6039c45 response_code = 204 uri = /switch-ports
20782024-11-22T20:34:00.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50612 req_id = 80c06499-09c5-4bde-ab02-d659b9a6c5ce response_code = 200 uri = /network-bootstore-config
20792024-11-22T20:34:00.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45964
20802024-11-22T20:34:00.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45964 req_id = 59c7647d-da53-4342-b21a-105b10a89979 response_code = 200 uri = /v2p
20812024-11-22T20:34:00.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37555 req_id = d34bba49-e412-4f4d-9bf1-8fc471fdf2f3 response_code = 204 uri = /vpc-routes
20822024-11-22T20:34:00.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51622
20832024-11-22T20:34:00.313ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20842024-11-22T20:34:00.346ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20852024-11-22T20:34:00.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89960 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51622 req_id = de034814-65e7-4a9d-9e62-6d98c6fa60a8 response_code = 204 uri = /switch-ports
20862024-11-22T20:34:00.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51622 req_id = 7d875a1c-c6d7-439e-aef5-06e4afb11832 response_code = 200 uri = /network-bootstore-config
20872024-11-22T20:34:11.406ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40689
20882024-11-22T20:34:11.407ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40689 req_id = f3f8ff9f-a498-4c41-bbe8-fa54fe6dd075 response_code = 200 uri = /baseboard
20892024-11-22T20:34:26.398ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6780 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 9f5e3c3b-08fb-4d65-88f5-d3dfec1128ac response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
20902024-11-22T20:34:29.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53101
20912024-11-22T20:34:29.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53101 req_id = 5e3c2d4e-3743-4484-81a6-9262fb4af2ca response_code = 200 uri = /vpc-routes
20922024-11-22T20:34:29.711ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
20932024-11-22T20:34:29.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53101 req_id = 2e2a90c4-aed1-4444-a4af-1e8257f61fe4 response_code = 204 uri = /eip-gateways
20942024-11-22T20:34:29.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53101 req_id = 24cad363-0102-4d66-a7bd-0c20a8ea4170 response_code = 204 uri = /vpc-routes
20952024-11-22T20:34:29.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36677
20962024-11-22T20:34:29.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36677 req_id = a160dbe8-702f-42e9-b1c5-440d4c7e6f7a response_code = 200 uri = /v2p
20972024-11-22T20:34:29.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42986
20982024-11-22T20:34:29.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42986 req_id = 437d521d-9632-4c74-9f27-730f6617c6d1 response_code = 200 uri = /v2p
20992024-11-22T20:34:29.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53106
21002024-11-22T20:34:29.836ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21012024-11-22T20:34:29.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21022024-11-22T20:34:29.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90877 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53106 req_id = e24ec163-7490-4d4a-b7d3-2e5774c8a7fe response_code = 204 uri = /switch-ports
21032024-11-22T20:34:29.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44652
21042024-11-22T20:34:29.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44652 req_id = 34e81734-5a0b-46c1-960a-6e5fe5049979 response_code = 200 uri = /vpc-routes
21052024-11-22T20:34:29.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53106 req_id = cd84b10c-d00c-4e96-b62c-327328179f18 response_code = 200 uri = /network-bootstore-config
21062024-11-22T20:34:29.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49762
21072024-11-22T20:34:29.958ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21082024-11-22T20:34:29.994ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21092024-11-22T20:34:30.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91035 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49762 req_id = 0de57d0f-d206-41d8-96ab-4af4eb109158 response_code = 204 uri = /switch-ports
21102024-11-22T20:34:30.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59584
21112024-11-22T20:34:30.049ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
21122024-11-22T20:34:30.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48444
21132024-11-22T20:34:30.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44652 req_id = 478fd924-8389-43bf-b275-045281fe6b71 response_code = 204 uri = /eip-gateways
21142024-11-22T20:34:30.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59584 req_id = 2e385f22-db0f-4afd-b1c6-e956a974539d response_code = 200 uri = /vpc-routes
21152024-11-22T20:34:30.049ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21162024-11-22T20:34:30.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49762 req_id = 9e28d72f-11f6-4d12-8a75-a0c6455b0075 response_code = 200 uri = /network-bootstore-config
21172024-11-22T20:34:30.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 434 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44652 req_id = 067171fa-9c9b-4272-8731-1fe7e446f404 response_code = 204 uri = /vpc-routes
21182024-11-22T20:34:30.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21192024-11-22T20:34:30.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37687
21202024-11-22T20:34:30.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37687 req_id = b5fc1aeb-05fa-4dd3-a408-0072867eb308 response_code = 200 uri = /v2p
21212024-11-22T20:34:30.091ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
21222024-11-22T20:34:30.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59584 req_id = 37726f38-62d2-42cb-bc71-6c1d46415381 response_code = 204 uri = /eip-gateways
21232024-11-22T20:34:30.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 667 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59584 req_id = 707667df-22c9-4d72-99f6-16553f93cf9a response_code = 204 uri = /vpc-routes
21242024-11-22T20:34:30.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94349 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48444 req_id = 7312391b-9ab1-458f-88fb-fb351e7ebafd response_code = 204 uri = /switch-ports
21252024-11-22T20:34:30.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48444 req_id = 6bbf8dfa-c50f-43eb-83c8-454b41b5fbdd response_code = 200 uri = /network-bootstore-config
21262024-11-22T20:34:41.440ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51175
21272024-11-22T20:34:41.440ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51175 req_id = a485a603-fbf0-421c-8aa7-dec7bd2ff245 response_code = 200 uri = /baseboard
21282024-11-22T20:34:56.399ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7522 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 86ed7851-d9ed-40ee-ac54-d909999d754e response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
21292024-11-22T20:34:59.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50519
21302024-11-22T20:34:59.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50519 req_id = a8bb873f-b5e7-4e90-b361-0fbc9718e432 response_code = 200 uri = /vpc-routes
21312024-11-22T20:34:59.922ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
21322024-11-22T20:34:59.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50519 req_id = b4debe89-b405-4b49-927f-20b6f2ec35c8 response_code = 204 uri = /eip-gateways
21332024-11-22T20:34:59.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52565
21342024-11-22T20:34:59.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52565 req_id = 011fb8f6-c618-44b1-9969-226b04d57c4c response_code = 200 uri = /v2p
21352024-11-22T20:34:59.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50519 req_id = f60fe0a5-1041-499a-a1d6-9ced8f00feed response_code = 204 uri = /vpc-routes
21362024-11-22T20:34:59.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54039
21372024-11-22T20:34:59.987ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21382024-11-22T20:35:00.042ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21392024-11-22T20:35:00.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130022 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54039 req_id = 29512804-de0c-4c52-a4e6-b1c61ca15f20 response_code = 204 uri = /switch-ports
21402024-11-22T20:35:00.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51799
21412024-11-22T20:35:00.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60037
21422024-11-22T20:35:00.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60037 req_id = 38be43df-3877-4739-b18a-3f2475950e75 response_code = 200 uri = /vpc-routes
21432024-11-22T20:35:00.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51799 req_id = 7ea5c4ad-fa5d-40c2-9809-5da7f615086f response_code = 200 uri = /vpc-routes
21442024-11-22T20:35:00.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54039 req_id = d10134f0-568c-4ccf-a03d-d5f9a202d275 response_code = 200 uri = /network-bootstore-config
21452024-11-22T20:35:00.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
21462024-11-22T20:35:00.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60037 req_id = 7ca59e47-d08e-4a50-9e7a-6ccc5d52511e response_code = 204 uri = /eip-gateways
21472024-11-22T20:35:00.181ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
21482024-11-22T20:35:00.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51799 req_id = db629c7b-27d7-467f-a1a1-3fef464b9a35 response_code = 204 uri = /eip-gateways
21492024-11-22T20:35:00.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60037 req_id = 6031b514-d0a3-4476-ac9f-e8ffe939e25a response_code = 204 uri = /vpc-routes
21502024-11-22T20:35:00.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33704
21512024-11-22T20:35:00.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21522024-11-22T20:35:00.231ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21532024-11-22T20:35:00.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102334 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33704 req_id = de46beab-5fed-4164-bcd9-384824bc6ad5 response_code = 204 uri = /switch-ports
21542024-11-22T20:35:00.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37606
21552024-11-22T20:35:00.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39082
21562024-11-22T20:35:00.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34785
21572024-11-22T20:35:00.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33704 req_id = 4e5e7487-8824-4526-8b13-86d548e08bab response_code = 200 uri = /network-bootstore-config
21582024-11-22T20:35:00.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34785 req_id = 8dd2fff9-1234-44f9-8f2f-12e4aca2dc0d response_code = 200 uri = /v2p
21592024-11-22T20:35:00.292ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21602024-11-22T20:35:00.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37606 req_id = 06e8ebe1-5a6a-4036-8ac3-94ee9e358f8e response_code = 200 uri = /v2p
21612024-11-22T20:35:00.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3950 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51799 req_id = 1cb2ce3c-5a3b-4605-8a34-20f58c0095cd response_code = 204 uri = /vpc-routes
21622024-11-22T20:35:00.328ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21632024-11-22T20:35:00.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89325 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39082 req_id = 91d216f0-c523-44ce-9790-8846b9d67d6c response_code = 204 uri = /switch-ports
21642024-11-22T20:35:00.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39082 req_id = 439923ec-54f4-4c60-9c76-f57e478490cb response_code = 200 uri = /network-bootstore-config
21652024-11-22T20:35:11.473ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55861
21662024-11-22T20:35:11.473ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55861 req_id = 2a37bafb-495d-42a4-b547-7150e40e2fda response_code = 200 uri = /baseboard
21672024-11-22T20:35:26.397ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6024 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 21ebfea0-0e17-43d3-a6c5-a9880de3df63 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
21682024-11-22T20:35:29.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55749
21692024-11-22T20:35:29.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55749 req_id = 120e943c-8300-430c-9666-667f7a3baaaf response_code = 200 uri = /vpc-routes
21702024-11-22T20:35:29.696ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
21712024-11-22T20:35:29.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55749 req_id = 4bc426bc-e2a7-4048-82b8-5a73c9ad1b4f response_code = 204 uri = /eip-gateways
21722024-11-22T20:35:29.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55749 req_id = bed78ddf-11f9-4b41-b33c-4dab8614bcf8 response_code = 204 uri = /vpc-routes
21732024-11-22T20:35:29.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54932
21742024-11-22T20:35:29.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21752024-11-22T20:35:29.781ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21762024-11-22T20:35:29.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95201 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54932 req_id = 26207bbe-a76f-49e5-89c3-11e85a9af701 response_code = 204 uri = /switch-ports
21772024-11-22T20:35:29.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63777
21782024-11-22T20:35:29.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50820
21792024-11-22T20:35:29.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42220
21802024-11-22T20:35:29.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42220 req_id = 4041a986-c194-4e4c-9f0e-310c087d3bfd response_code = 200 uri = /vpc-routes
21812024-11-22T20:35:29.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50820 req_id = 68a00a0e-958e-49e9-80f5-a9fe6eb8f4c3 response_code = 200 uri = /vpc-routes
21822024-11-22T20:35:29.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63777 req_id = 18ea2a35-575c-468a-a722-3fe8c5ba0067 response_code = 200 uri = /v2p
21832024-11-22T20:35:29.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54932 req_id = b57b82ce-3323-43b6-9dab-0fa2b0c84ae3 response_code = 200 uri = /network-bootstore-config
21842024-11-22T20:35:29.855ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
21852024-11-22T20:35:29.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50820 req_id = ba40056b-7b29-4bd1-bd4e-63ec4508a4b9 response_code = 204 uri = /eip-gateways
21862024-11-22T20:35:29.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 968 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50820 req_id = 553547d4-2b11-431d-9fb3-638de5449d95 response_code = 204 uri = /vpc-routes
21872024-11-22T20:35:29.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
21882024-11-22T20:35:29.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42220 req_id = e25d887f-c75f-4aa4-941f-b7e698255a21 response_code = 204 uri = /eip-gateways
21892024-11-22T20:35:29.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42220 req_id = 971add6f-4ef3-42e8-a9ad-79598490490d response_code = 204 uri = /vpc-routes
21902024-11-22T20:35:29.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44633
21912024-11-22T20:35:29.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44633 req_id = a0f82d12-32eb-4074-8f3d-8f337661a7d9 response_code = 200 uri = /v2p
21922024-11-22T20:35:29.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41364
21932024-11-22T20:35:29.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41364 req_id = e7c054e1-8986-4299-ba1e-f08fbb3f8f99 response_code = 200 uri = /v2p
21942024-11-22T20:35:29.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38076
21952024-11-22T20:35:29.947ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21962024-11-22T20:35:29.982ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21972024-11-22T20:35:30.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86596 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38076 req_id = b8dc26f1-ccae-4515-8244-5d331dc23483 response_code = 204 uri = /switch-ports
21982024-11-22T20:35:30.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37538
21992024-11-22T20:35:30.034ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22002024-11-22T20:35:30.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22012024-11-22T20:35:30.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85171 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37538 req_id = 3caacea9-feed-432a-8c60-f1ce7e0b36db response_code = 204 uri = /switch-ports
22022024-11-22T20:35:30.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38076 req_id = cf44298b-87af-4739-8da3-3bde6b51ebb5 response_code = 200 uri = /network-bootstore-config
22032024-11-22T20:35:30.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37538 req_id = 930531b8-8fec-4c93-8dad-04e4e831a00c response_code = 200 uri = /network-bootstore-config
22042024-11-22T20:35:41.508ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60155
22052024-11-22T20:35:41.508ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60155 req_id = 86429d3f-d976-4d09-9cec-f812af733e2f response_code = 200 uri = /baseboard
22062024-11-22T20:35:56.397ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6685 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 6a7a0e47-effd-42ac-813d-5d886ea38efd response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
22072024-11-22T20:35:59.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59783
22082024-11-22T20:35:59.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59783 req_id = 4be61afb-3e7c-447b-b118-6becefcebd8a response_code = 200 uri = /vpc-routes
22092024-11-22T20:35:59.806ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
22102024-11-22T20:35:59.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59783 req_id = f1fe86bf-48cf-4f95-a9c1-aac522c6087d response_code = 204 uri = /eip-gateways
22112024-11-22T20:35:59.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33342
22122024-11-22T20:35:59.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33342 req_id = d1ff13d7-ad01-4e57-8fa1-e7d1b844d563 response_code = 200 uri = /vpc-routes
22132024-11-22T20:35:59.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59783 req_id = 11a6a28f-3638-4818-8104-276a6efd6449 response_code = 204 uri = /vpc-routes
22142024-11-22T20:35:59.870ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
22152024-11-22T20:35:59.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33342 req_id = 62e04a95-f11d-4e55-abdf-2195b4cbd5a3 response_code = 204 uri = /eip-gateways
22162024-11-22T20:35:59.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33342 req_id = 1b49898b-0c4f-4da3-997c-141cdbd221d8 response_code = 204 uri = /vpc-routes
22172024-11-22T20:35:59.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44412
22182024-11-22T20:35:59.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44412 req_id = f5e08ea7-8bfd-42e8-9b42-67ad7a37657d response_code = 200 uri = /v2p
22192024-11-22T20:35:59.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48061
22202024-11-22T20:35:59.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22212024-11-22T20:35:59.998ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22222024-11-22T20:36:00.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48061 req_id = fe1ceac9-7923-4a7b-ae06-e379dde7fabc response_code = 204 uri = /switch-ports
22232024-11-22T20:36:00.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62633
22242024-11-22T20:36:00.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61040
22252024-11-22T20:36:00.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61223
22262024-11-22T20:36:00.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62633 req_id = 69d7677a-d868-4add-a9ec-7884a8242390 response_code = 200 uri = /vpc-routes
22272024-11-22T20:36:00.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61223 req_id = 0e74b882-3bde-4366-a4c2-56b75034f2e7 response_code = 200 uri = /v2p
22282024-11-22T20:36:00.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48061 req_id = 5f53491c-6ca4-4643-983f-c4bb17767b06 response_code = 200 uri = /network-bootstore-config
22292024-11-22T20:36:00.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61040 req_id = 07d0020c-8836-4644-854c-bfd58d19ec98 response_code = 200 uri = /v2p
22302024-11-22T20:36:00.070ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
22312024-11-22T20:36:00.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62633 req_id = 524c4282-5c7b-4d4d-8469-e021a8090311 response_code = 204 uri = /eip-gateways
22322024-11-22T20:36:00.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62633 req_id = e66b8e11-57ad-4588-952a-7e62199fd59b response_code = 204 uri = /vpc-routes
22332024-11-22T20:36:00.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33917
22342024-11-22T20:36:00.121ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22352024-11-22T20:36:00.157ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22362024-11-22T20:36:00.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91024 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33917 req_id = be7ba6b9-2016-4bb2-9eee-939bbc38b77b response_code = 204 uri = /switch-ports
22372024-11-22T20:36:00.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59543
22382024-11-22T20:36:00.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33917 req_id = 682326b4-d783-4a72-b3fb-fce9fb4dac9f response_code = 200 uri = /network-bootstore-config
22392024-11-22T20:36:00.213ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22402024-11-22T20:36:00.250ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22412024-11-22T20:36:00.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92548 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59543 req_id = 5eb98d99-8303-4e49-8939-76568bbd332a response_code = 204 uri = /switch-ports
22422024-11-22T20:36:00.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59543 req_id = ff0223c5-ea28-4b31-9f41-028b422d2bd9 response_code = 200 uri = /network-bootstore-config
22432024-11-22T20:36:11.541ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42756
22442024-11-22T20:36:11.541ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42756 req_id = 348e2c39-7b42-4b74-90e2-1faac42b7711 response_code = 200 uri = /baseboard
22452024-11-22T20:36:26.396ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5680 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = fdb0b3ec-1fbd-41a0-9df9-c62ab3b1ee11 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
22462024-11-22T20:36:29.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61246
22472024-11-22T20:36:29.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61246 req_id = a70bb18f-47fd-49b1-a832-b8badf399cb6 response_code = 200 uri = /v2p
22482024-11-22T20:36:29.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33941
22492024-11-22T20:36:29.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33941 req_id = 554fc47b-4dc9-4f80-89ed-e98b3935e392 response_code = 200 uri = /vpc-routes
22502024-11-22T20:36:29.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58962
22512024-11-22T20:36:29.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58962 req_id = 83f8791e-c761-4096-872d-c2a2f5521411 response_code = 200 uri = /vpc-routes
22522024-11-22T20:36:29.810ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
22532024-11-22T20:36:29.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58962 req_id = 3a91c8a2-7d4f-4431-9a56-b588b24cc7b1 response_code = 204 uri = /eip-gateways
22542024-11-22T20:36:29.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58962 req_id = c3a36c7b-b5bb-4de0-8072-c0084e878274 response_code = 204 uri = /vpc-routes
22552024-11-22T20:36:29.833ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
22562024-11-22T20:36:29.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33941 req_id = 88b69117-8028-430d-a49f-d95d75afc613 response_code = 204 uri = /eip-gateways
22572024-11-22T20:36:29.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33941 req_id = eba71da4-4150-4553-a393-acf737b231ce response_code = 204 uri = /vpc-routes
22582024-11-22T20:36:29.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52925
22592024-11-22T20:36:29.851ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22602024-11-22T20:36:29.890ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22612024-11-22T20:36:29.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94793 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52925 req_id = 178ac402-1e9a-425a-b437-3db52b671e86 response_code = 204 uri = /switch-ports
22622024-11-22T20:36:29.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39295
22632024-11-22T20:36:29.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57723
22642024-11-22T20:36:29.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35026
22652024-11-22T20:36:29.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48163
22662024-11-22T20:36:29.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52925 req_id = 5519cc7d-e429-4247-bd58-2f1298f9cfa0 response_code = 200 uri = /network-bootstore-config
22672024-11-22T20:36:29.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39295 req_id = 1170497e-a345-41eb-adfb-5374522cfad3 response_code = 200 uri = /vpc-routes
22682024-11-22T20:36:29.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57723 req_id = dea4d833-8b23-49de-ae8e-49857ed4a258 response_code = 200 uri = /v2p
22692024-11-22T20:36:29.947ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22702024-11-22T20:36:29.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48163 req_id = d361ac99-3cd7-4c3e-a09e-db5bd9ac7f52 response_code = 200 uri = /v2p
22712024-11-22T20:36:29.964ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
22722024-11-22T20:36:29.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39295 req_id = 28fdae48-128e-494c-8540-9bd9eff00308 response_code = 204 uri = /eip-gateways
22732024-11-22T20:36:29.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 957 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39295 req_id = d2ad69d1-792e-4776-8757-d42476e40ebe response_code = 204 uri = /vpc-routes
22742024-11-22T20:36:29.984ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22752024-11-22T20:36:29.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63627
22762024-11-22T20:36:30.037ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22772024-11-22T20:36:30.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90442 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35026 req_id = 0e521caf-9acb-4ccc-a639-b4b8536853a5 response_code = 204 uri = /switch-ports
22782024-11-22T20:36:30.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 466 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35026 req_id = a81dbbca-e517-42ee-901a-862b7905d872 response_code = 200 uri = /network-bootstore-config
22792024-11-22T20:36:30.071ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22802024-11-22T20:36:30.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122859 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63627 req_id = 124df3d2-d278-4953-b5d5-8c2541eabed5 response_code = 204 uri = /switch-ports
22812024-11-22T20:36:30.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63627 req_id = 4ef430e5-19b7-403c-92f3-57f96b0d1fdf response_code = 200 uri = /network-bootstore-config
22822024-11-22T20:36:41.574ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48528
22832024-11-22T20:36:41.575ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48528 req_id = 8d261012-2ac6-4670-9090-6ea7661c2370 response_code = 200 uri = /baseboard
22842024-11-22T20:36:56.397ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7002 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 8d6271fd-d913-48cf-a187-52e80bc9f4e1 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
22852024-11-22T20:36:59.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37165
22862024-11-22T20:36:59.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37165 req_id = 2b426017-d94b-495c-b418-968c76e110d7 response_code = 200 uri = /vpc-routes
22872024-11-22T20:36:59.919ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
22882024-11-22T20:36:59.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37165 req_id = 182a9a28-1f84-48c9-aaab-f174b442629b response_code = 204 uri = /eip-gateways
22892024-11-22T20:36:59.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37165 req_id = ead839ef-1a38-4544-8206-938ea72668d2 response_code = 204 uri = /vpc-routes
22902024-11-22T20:36:59.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36207
22912024-11-22T20:36:59.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36207 req_id = 96bde9dd-5066-4a3f-8055-06ee9e54c1a6 response_code = 200 uri = /vpc-routes
22922024-11-22T20:36:59.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47609
22932024-11-22T20:36:59.955ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22942024-11-22T20:37:00.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22952024-11-22T20:37:00.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105067 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47609 req_id = 0716ab62-b662-47a4-8628-7ae68244e4db response_code = 204 uri = /switch-ports
22962024-11-22T20:37:00.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42186
22972024-11-22T20:37:00.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63024
22982024-11-22T20:37:00.060ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
22992024-11-22T20:37:00.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36207 req_id = f55bfa49-0a61-4ada-8ccd-c8596fc8f6b1 response_code = 204 uri = /eip-gateways
23002024-11-22T20:37:00.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47609 req_id = 37673a54-f3b1-4d35-8762-43c7b91742f5 response_code = 200 uri = /network-bootstore-config
23012024-11-22T20:37:00.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63024 req_id = 5dd6f4a2-76d0-40ff-bb9d-b0f7cb0c39f0 response_code = 200 uri = /v2p
23022024-11-22T20:37:00.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42186 req_id = 0f9fec8c-09ab-418e-9b70-ecde21cf3868 response_code = 200 uri = /v2p
23032024-11-22T20:37:00.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36207 req_id = cf33de3e-e783-4808-89a6-5399d96ecf4b response_code = 204 uri = /vpc-routes
23042024-11-22T20:37:00.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46185
23052024-11-22T20:37:00.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46185 req_id = 9c9dfa53-da06-4323-885f-d0cb31ff9adc response_code = 200 uri = /vpc-routes
23062024-11-22T20:37:00.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62809
23072024-11-22T20:37:00.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62809 req_id = a9dfb9c9-96be-49f6-8a1a-06936c8b99d0 response_code = 200 uri = /v2p
23082024-11-22T20:37:00.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56252
23092024-11-22T20:37:00.132ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23102024-11-22T20:37:00.132ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23112024-11-22T20:37:00.132ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23122024-11-22T20:37:00.132ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23132024-11-22T20:37:00.132ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23142024-11-22T20:37:00.132ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23152024-11-22T20:37:00.132ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23162024-11-22T20:37:00.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 485 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56252 req_id = 5998a9b5-bb86-42d5-8099-7b4daa9f0e1c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23172024-11-22T20:37:00.163ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
23182024-11-22T20:37:00.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46185 req_id = 08f10b89-c11f-4f29-93d8-7ca5f710d212 response_code = 204 uri = /eip-gateways
23192024-11-22T20:37:00.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52829
23202024-11-22T20:37:00.165ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23212024-11-22T20:37:00.209ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23222024-11-22T20:37:00.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101296 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52829 req_id = 1cc2ce16-8736-42f4-bcff-1096e4e34975 response_code = 204 uri = /switch-ports
23232024-11-22T20:37:00.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52829 req_id = 6697aa0b-8244-4bb5-8982-90744b437a0b response_code = 200 uri = /network-bootstore-config
23242024-11-22T20:37:00.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 518 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46185 req_id = 06843d0f-c4b4-4928-92aa-af3cb82e2394 response_code = 204 uri = /vpc-routes
23252024-11-22T20:37:00.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56905
23262024-11-22T20:37:00.287ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23272024-11-22T20:37:00.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23282024-11-22T20:37:00.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23292024-11-22T20:37:00.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23302024-11-22T20:37:00.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23312024-11-22T20:37:00.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23322024-11-22T20:37:00.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23332024-11-22T20:37:00.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 400 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56905 req_id = 059dbc07-1751-4e69-8cf0-1b591d1cea8d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23342024-11-22T20:37:00.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47592
23352024-11-22T20:37:00.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23362024-11-22T20:37:00.365ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23372024-11-22T20:37:00.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86962 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47592 req_id = 400bb6b3-4780-4531-a746-e46951ba4d9a response_code = 204 uri = /switch-ports
23382024-11-22T20:37:00.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61601
23392024-11-22T20:37:00.416ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23402024-11-22T20:37:00.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47592 req_id = c66a784d-890a-48af-afed-827e45a534e3 response_code = 200 uri = /network-bootstore-config
23412024-11-22T20:37:00.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23422024-11-22T20:37:00.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23432024-11-22T20:37:00.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23442024-11-22T20:37:00.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23452024-11-22T20:37:00.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23462024-11-22T20:37:00.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23472024-11-22T20:37:00.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 391 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61601 req_id = ae43b5a2-8e96-49d2-a774-6fc878e7309e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23482024-11-22T20:37:11.608ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51570
23492024-11-22T20:37:11.608ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51570 req_id = 222ad43b-a043-4cd6-a4c3-55dd92042c6a response_code = 200 uri = /baseboard
23502024-11-22T20:37:20.009ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23512024-11-22T20:37:20.009ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23522024-11-22T20:37:20.038ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 4599, tv_nsec: 347994350 } time_to_next_cleanup = 599.999997919s
23532024-11-22T20:37:26.396ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6434 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 3760041b-8be1-4287-81b0-a63881f37d17 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
23542024-11-22T20:37:29.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50605
23552024-11-22T20:37:29.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50605 req_id = c922e723-5b91-4810-9d43-03d986a96c94 response_code = 200 uri = /vpc-routes
23562024-11-22T20:37:29.651ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
23572024-11-22T20:37:29.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50605 req_id = 73052915-8c53-4a0d-a3b6-adb79f3e87a3 response_code = 204 uri = /eip-gateways
23582024-11-22T20:37:29.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35213
23592024-11-22T20:37:29.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35213 req_id = 2ce16244-e483-4ee2-8692-67766e2cc1d7 response_code = 200 uri = /v2p
23602024-11-22T20:37:29.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50605 req_id = 44b80454-a3a8-41f1-880a-6308c5e58549 response_code = 204 uri = /vpc-routes
23612024-11-22T20:37:29.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47359
23622024-11-22T20:37:29.771ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23632024-11-22T20:37:29.814ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23642024-11-22T20:37:29.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111283 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47359 req_id = b21105ff-938f-46c4-898a-cd44a26c6571 response_code = 204 uri = /switch-ports
23652024-11-22T20:37:29.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34083
23662024-11-22T20:37:29.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47359 req_id = d6e8a1d7-106b-47e2-982d-6317ab12f9e9 response_code = 200 uri = /network-bootstore-config
23672024-11-22T20:37:29.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34083 req_id = 3a4c83ae-2b60-4ba7-b5d2-9ac16ebf3b43 response_code = 200 uri = /vpc-routes
23682024-11-22T20:37:29.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65330
23692024-11-22T20:37:29.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65330 req_id = be455485-dcbe-425c-b0d5-4efc6335b39b response_code = 200 uri = /v2p
23702024-11-22T20:37:29.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62565
23712024-11-22T20:37:29.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62565 req_id = ebec383a-69c5-4cf9-b077-6751185ad1ce response_code = 200 uri = /vpc-routes
23722024-11-22T20:37:29.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45205
23732024-11-22T20:37:29.903ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23742024-11-22T20:37:29.943ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23752024-11-22T20:37:30.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96971 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45205 req_id = 4b0113ca-28f7-4fc4-b237-758b1a0869a6 response_code = 204 uri = /switch-ports
23762024-11-22T20:37:30.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39847
23772024-11-22T20:37:30.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
23782024-11-22T20:37:30.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55360
23792024-11-22T20:37:30.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62565 req_id = 39227fe8-9d9c-4011-903f-3e65f3d06a1f response_code = 204 uri = /eip-gateways
23802024-11-22T20:37:30.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45205 req_id = 43160e81-8211-4424-b3d0-b7b0282d468b response_code = 200 uri = /network-bootstore-config
23812024-11-22T20:37:30.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
23822024-11-22T20:37:30.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34083 req_id = 0f02361f-e04d-4148-ad9d-4ba10ce01418 response_code = 204 uri = /eip-gateways
23832024-11-22T20:37:30.001ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23842024-11-22T20:37:30.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39847 req_id = cdd5e818-6492-47ec-990f-c662e63e1eaa response_code = 200 uri = /v2p
23852024-11-22T20:37:30.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 382 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62565 req_id = 77590b30-3a65-4b83-8dce-fbbd17a60ac4 response_code = 204 uri = /vpc-routes
23862024-11-22T20:37:30.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34083 req_id = 586cb213-af1b-4767-b3c5-713dabd59f60 response_code = 204 uri = /vpc-routes
23872024-11-22T20:37:30.041ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23882024-11-22T20:37:30.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55360 req_id = 114f53d3-8eb0-4c17-a5a7-0235a0b37b40 response_code = 204 uri = /switch-ports
23892024-11-22T20:37:30.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55360 req_id = a2ef5a88-0f2f-4ee3-8a9f-48a70154534c response_code = 200 uri = /network-bootstore-config
23902024-11-22T20:37:34.874ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23912024-11-22T20:37:41.641ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35442
23922024-11-22T20:37:41.641ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35442 req_id = 59b5e9ed-1935-4e8f-be8c-b0643db1e6e2 response_code = 200 uri = /baseboard
23932024-11-22T20:37:56.396ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6790 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 4e4e2939-ed8a-4e2f-a840-fface4fd9c69 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
23942024-11-22T20:37:59.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49542
23952024-11-22T20:37:59.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49542 req_id = 58f03d6b-706b-4785-bfec-66cec168b3e3 response_code = 200 uri = /vpc-routes
23962024-11-22T20:37:59.764ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
23972024-11-22T20:37:59.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49542 req_id = 0254f50c-e1dd-4a9f-8f20-ed2ca9e46b82 response_code = 204 uri = /eip-gateways
23982024-11-22T20:37:59.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49542 req_id = eadc11e8-ed48-4421-bf31-6617f5d92677 response_code = 204 uri = /vpc-routes
23992024-11-22T20:37:59.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63346
24002024-11-22T20:37:59.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63346 req_id = 0fffa2e0-ffcd-438d-8130-019c902dec36 response_code = 200 uri = /v2p
24012024-11-22T20:37:59.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56177
24022024-11-22T20:37:59.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56177 req_id = 032fa303-5fc9-45a7-abeb-eecf33c066f5 response_code = 200 uri = /vpc-routes
24032024-11-22T20:37:59.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57291
24042024-11-22T20:37:59.875ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24052024-11-22T20:37:59.917ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24062024-11-22T20:37:59.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105271 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57291 req_id = 3dca86bd-75fe-4a05-bc0a-abd2d881e3e7 response_code = 204 uri = /switch-ports
24072024-11-22T20:37:59.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
24082024-11-22T20:37:59.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56177 req_id = 692dce3f-83b5-460f-8dd2-35661f2f8096 response_code = 204 uri = /eip-gateways
24092024-11-22T20:37:59.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62091
24102024-11-22T20:37:59.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57291 req_id = d92a2afe-2474-47b5-b9dc-38b3b5145a1f response_code = 200 uri = /network-bootstore-config
24112024-11-22T20:37:59.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62091 req_id = 01ebd72e-dea9-41d2-af12-da679fbe8d39 response_code = 200 uri = /vpc-routes
24122024-11-22T20:37:59.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56177 req_id = 76b45d45-fe10-409f-a614-28644d89454d response_code = 204 uri = /vpc-routes
24132024-11-22T20:37:59.997ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
24142024-11-22T20:37:59.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62091 req_id = ddd3c207-1846-4b01-9e70-435e42727947 response_code = 204 uri = /eip-gateways
24152024-11-22T20:38:00.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54681
24162024-11-22T20:38:00.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24172024-11-22T20:38:00.089ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24182024-11-22T20:38:00.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88514 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54681 req_id = 1066cef0-87cb-4cb6-b205-2a9b243a8563 response_code = 204 uri = /switch-ports
24192024-11-22T20:38:00.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33153
24202024-11-22T20:38:00.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33153 req_id = d808b7ca-fc3c-47fc-9ee0-2e5a5dc4a5a6 response_code = 200 uri = /v2p
24212024-11-22T20:38:00.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54681 req_id = 60bb9570-86fc-46ee-998b-3ff005fc4fd7 response_code = 200 uri = /network-bootstore-config
24222024-11-22T20:38:00.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42613
24232024-11-22T20:38:00.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42613 req_id = f15ba02e-2a57-43b3-8f8d-0c33087559b1 response_code = 200 uri = /v2p
24242024-11-22T20:38:00.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62091 req_id = c53adcc1-8c31-4f4d-ab44-2278c954bb80 response_code = 204 uri = /vpc-routes
24252024-11-22T20:38:00.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42685
24262024-11-22T20:38:00.258ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24272024-11-22T20:38:00.296ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24282024-11-22T20:38:00.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42685 req_id = 952d64e4-8947-400c-a261-7a2d8d1e98e1 response_code = 204 uri = /switch-ports
24292024-11-22T20:38:00.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42685 req_id = fd5b13c0-4b24-461e-a67b-f0fcde0c6c74 response_code = 200 uri = /network-bootstore-config
24302024-11-22T20:38:11.674ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56704
24312024-11-22T20:38:11.674ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56704 req_id = 2a4d58d6-31e8-450b-abe0-0c6644d86aa1 response_code = 200 uri = /baseboard
24322024-11-22T20:38:26.397ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6588 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = a93bf8d2-0bac-4c3f-9647-b358932b7255 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
24332024-11-22T20:38:29.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38596
24342024-11-22T20:38:29.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38596 req_id = dc4f70d3-0414-42e3-98f9-686fe741a8d3 response_code = 200 uri = /vpc-routes
24352024-11-22T20:38:29.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
24362024-11-22T20:38:29.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38596 req_id = e2766f8f-996f-4366-a33f-608519c1e40f response_code = 204 uri = /eip-gateways
24372024-11-22T20:38:29.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38596 req_id = eb9a86c9-1fd7-4aa6-b766-b950fcf665ae response_code = 204 uri = /vpc-routes
24382024-11-22T20:38:29.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36037
24392024-11-22T20:38:29.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36037 req_id = 67e32f95-bb0a-4d95-bc65-b91a7ddb79db response_code = 200 uri = /v2p
24402024-11-22T20:38:29.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43790
24412024-11-22T20:38:29.717ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24422024-11-22T20:38:29.754ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24432024-11-22T20:38:29.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90593 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43790 req_id = f99e5f79-61bc-472c-9be8-b4e971bf3c86 response_code = 204 uri = /switch-ports
24442024-11-22T20:38:29.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60092
24452024-11-22T20:38:29.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58464
24462024-11-22T20:38:29.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43790 req_id = 4b0b91c9-fc09-426d-ae9b-dc5e51645e15 response_code = 200 uri = /network-bootstore-config
24472024-11-22T20:38:29.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58464 req_id = 51829ded-d326-44dd-ad98-a241b102335f response_code = 200 uri = /vpc-routes
24482024-11-22T20:38:29.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60092 req_id = 0464e38c-3ab2-4ee3-a0c2-6f0c422a02ad response_code = 200 uri = /v2p
24492024-11-22T20:38:29.861ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
24502024-11-22T20:38:29.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58464 req_id = abcbabf4-1c0d-4ab3-ae58-1c2f19e45ddc response_code = 204 uri = /eip-gateways
24512024-11-22T20:38:29.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58464 req_id = eb8f8985-9e86-43dc-8ec6-3245344afadb response_code = 204 uri = /vpc-routes
24522024-11-22T20:38:29.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64375
24532024-11-22T20:38:29.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64375 req_id = a704936c-97bf-4a46-b32a-b01fe0de7782 response_code = 200 uri = /vpc-routes
24542024-11-22T20:38:30.008ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
24552024-11-22T20:38:30.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64375 req_id = d6c1fa9a-28a8-4ba7-a727-5d4b35c6281d response_code = 204 uri = /eip-gateways
24562024-11-22T20:38:30.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36012
24572024-11-22T20:38:30.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36012 req_id = 29f328d4-a4da-4c1e-9cf1-da0a4645917b response_code = 200 uri = /v2p
24582024-11-22T20:38:30.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37605
24592024-11-22T20:38:30.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24602024-11-22T20:38:30.049ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24612024-11-22T20:38:30.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91609 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37605 req_id = ead212e1-b780-4867-8b77-94446139e920 response_code = 204 uri = /switch-ports
24622024-11-22T20:38:30.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56273
24632024-11-22T20:38:30.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37605 req_id = 17a7ae1e-01f3-4154-a42c-f82d941b1fae response_code = 200 uri = /network-bootstore-config
24642024-11-22T20:38:30.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 443 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64375 req_id = aad1149c-50d9-442b-a860-cb84723f6ee3 response_code = 204 uri = /vpc-routes
24652024-11-22T20:38:30.103ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24662024-11-22T20:38:30.139ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24672024-11-22T20:38:30.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88582 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56273 req_id = dc75a655-3407-4b6b-bd22-1869fa5113c4 response_code = 204 uri = /switch-ports
24682024-11-22T20:38:30.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56273 req_id = 6da253f7-b13a-4720-9a10-8c5b1720f610 response_code = 200 uri = /network-bootstore-config
24692024-11-22T20:38:41.709ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60584
24702024-11-22T20:38:41.710ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60584 req_id = 7687f82c-4b8e-4c82-bd00-dc223f55a3bd response_code = 200 uri = /baseboard
24712024-11-22T20:38:56.397ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7439 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = c9567925-7056-4f5e-8958-cef5b4a1aea1 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
24722024-11-22T20:38:59.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63669
24732024-11-22T20:38:59.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63669 req_id = 11e6d37a-397a-46ed-b199-eff572efe28f response_code = 200 uri = /v2p
24742024-11-22T20:38:59.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47390
24752024-11-22T20:38:59.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47390 req_id = ea1fdd24-aff5-4c12-b531-05e898cf1657 response_code = 200 uri = /vpc-routes
24762024-11-22T20:38:59.778ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
24772024-11-22T20:38:59.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47390 req_id = 96770a18-5c31-4bcf-9feb-444b8b2cfe99 response_code = 204 uri = /eip-gateways
24782024-11-22T20:38:59.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47390 req_id = 0b09d166-e948-4d9c-b017-578d25b0733c response_code = 204 uri = /vpc-routes
24792024-11-22T20:38:59.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61192
24802024-11-22T20:38:59.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61192 req_id = fa95cfaf-0ada-48b4-b287-4150fd314056 response_code = 200 uri = /vpc-routes
24812024-11-22T20:38:59.900ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
24822024-11-22T20:38:59.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61192 req_id = 5f34ccb2-7d62-4f7b-b87b-b13748228bd6 response_code = 204 uri = /eip-gateways
24832024-11-22T20:38:59.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46562
24842024-11-22T20:38:59.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46562 req_id = cbd84a41-b0ce-4f42-be1a-f034a85c5f5d response_code = 200 uri = /vpc-routes
24852024-11-22T20:38:59.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61192 req_id = 83c98e9c-0e57-4aef-8f7f-f49465c31cfe response_code = 204 uri = /vpc-routes
24862024-11-22T20:38:59.936ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
24872024-11-22T20:38:59.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46562 req_id = 6c25f95e-ebfd-4409-9c01-ad10e177910d response_code = 204 uri = /eip-gateways
24882024-11-22T20:39:00.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36534
24892024-11-22T20:39:00.009ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24902024-11-22T20:39:00.048ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24912024-11-22T20:39:00.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94189 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36534 req_id = 078a5ea4-ff40-414a-8a30-5b108bb4d371 response_code = 204 uri = /switch-ports
24922024-11-22T20:39:00.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38831
24932024-11-22T20:39:00.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40964
24942024-11-22T20:39:00.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36534 req_id = b11e9080-c082-4951-a722-6718ad1da7cb response_code = 200 uri = /network-bootstore-config
24952024-11-22T20:39:00.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38831 req_id = de178d44-4dde-4ad4-9596-1db2eb0bf04e response_code = 200 uri = /v2p
24962024-11-22T20:39:00.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 602 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46562 req_id = 6cd05e17-1314-4c63-b372-f5d6bb049554 response_code = 204 uri = /vpc-routes
24972024-11-22T20:39:00.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40964 req_id = 86f76540-89d0-4ef7-a660-145a41f22847 response_code = 200 uri = /v2p
24982024-11-22T20:39:00.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47269
24992024-11-22T20:39:00.166ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25002024-11-22T20:39:00.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25012024-11-22T20:39:00.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92131 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47269 req_id = f1a1bf6d-86db-4be5-afce-9dce13a10b83 response_code = 204 uri = /switch-ports
25022024-11-22T20:39:00.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45860
25032024-11-22T20:39:00.259ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25042024-11-22T20:39:00.291ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25052024-11-22T20:39:00.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85796 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45860 req_id = 6ce31e24-f3bf-43b5-bfb4-cfa1caf5be78 response_code = 204 uri = /switch-ports
25062024-11-22T20:39:00.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47269 req_id = c7b27e68-a81a-4ef6-bf2c-ec638e8d5314 response_code = 200 uri = /network-bootstore-config
25072024-11-22T20:39:00.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45860 req_id = 333a9979-0ebc-434a-be44-5c3580f627f2 response_code = 200 uri = /network-bootstore-config
25082024-11-22T20:39:11.743ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61993
25092024-11-22T20:39:11.743ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61993 req_id = e576feb0-4348-42c2-a306-620a17307706 response_code = 200 uri = /baseboard
25102024-11-22T20:39:26.397ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7230 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 10c2586f-2868-47f1-ae99-23c9e7dfc48c response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
25112024-11-22T20:39:29.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39337
25122024-11-22T20:39:29.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39337 req_id = cc2301f4-01f0-4be5-abae-5b84861de4b5 response_code = 200 uri = /vpc-routes
25132024-11-22T20:39:29.609ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
25142024-11-22T20:39:29.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39337 req_id = 97f43d22-8e04-4445-a081-78dc31078bd8 response_code = 204 uri = /eip-gateways
25152024-11-22T20:39:29.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39337 req_id = bdb45009-69f6-43ed-8aae-4edcbe09cf04 response_code = 204 uri = /vpc-routes
25162024-11-22T20:39:29.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40797
25172024-11-22T20:39:29.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40797 req_id = 70b39072-d4b2-4e0a-9be3-1c76e07402d4 response_code = 200 uri = /v2p
25182024-11-22T20:39:29.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48442
25192024-11-22T20:39:29.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25202024-11-22T20:39:29.776ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25212024-11-22T20:39:29.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48442 req_id = 856515f7-6ad2-42fc-a2cb-fdfe66a76db1 response_code = 204 uri = /switch-ports
25222024-11-22T20:39:29.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64888
25232024-11-22T20:39:29.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39378
25242024-11-22T20:39:29.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54065
25252024-11-22T20:39:29.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48442 req_id = 3635db76-a24f-48ee-8a35-f2071ed6edc8 response_code = 200 uri = /network-bootstore-config
25262024-11-22T20:39:29.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64888 req_id = 5c3f3488-7d00-46d4-bf5a-3aeedfe128df response_code = 200 uri = /vpc-routes
25272024-11-22T20:39:29.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39378 req_id = 4f16740f-e917-4093-b800-08e989d1d52a response_code = 200 uri = /vpc-routes
25282024-11-22T20:39:29.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54065 req_id = 1e180720-a45a-4e5b-92ef-beb202f8731e response_code = 200 uri = /v2p
25292024-11-22T20:39:29.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
25302024-11-22T20:39:29.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39378 req_id = e23c7434-feb6-469a-9771-1d26c12a8759 response_code = 204 uri = /eip-gateways
25312024-11-22T20:39:29.851ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
25322024-11-22T20:39:29.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64888 req_id = 48ad1b25-b0a4-41cd-a5f9-3917fa73477d response_code = 204 uri = /eip-gateways
25332024-11-22T20:39:29.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39378 req_id = 26e56573-d1c4-4800-8c8a-30f652f57799 response_code = 204 uri = /vpc-routes
25342024-11-22T20:39:29.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64888 req_id = 2addc8b5-4dd4-4f45-9da3-16103be8df8e response_code = 204 uri = /vpc-routes
25352024-11-22T20:39:29.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55154
25362024-11-22T20:39:29.870ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25372024-11-22T20:39:29.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25382024-11-22T20:39:29.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55154 req_id = e23a63ce-4e7f-484f-85db-47d9d41cc7a4 response_code = 204 uri = /switch-ports
25392024-11-22T20:39:29.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63640
25402024-11-22T20:39:29.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55531
25412024-11-22T20:39:29.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55531 req_id = 5042c85b-a590-403e-96ff-563167ff62f7 response_code = 200 uri = /v2p
25422024-11-22T20:39:29.961ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25432024-11-22T20:39:29.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55154 req_id = 5e6f5f3c-bee7-4495-a700-fecf7a75ca6d response_code = 200 uri = /network-bootstore-config
25442024-11-22T20:39:29.995ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25452024-11-22T20:39:30.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63640 req_id = cef50f77-6c80-4120-a97e-894369c37b66 response_code = 204 uri = /switch-ports
25462024-11-22T20:39:30.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63640 req_id = 1a87e066-1905-4457-bd50-efac11164b9a response_code = 200 uri = /network-bootstore-config
25472024-11-22T20:39:41.777ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35024
25482024-11-22T20:39:41.777ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35024 req_id = 09008b7f-a436-4c22-bf94-5107713ccdc9 response_code = 200 uri = /baseboard
25492024-11-22T20:39:56.396ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6812 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 7fccf917-5b8c-4044-9e9b-1ba5221c775e response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
25502024-11-22T20:39:59.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49652
25512024-11-22T20:39:59.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49652 req_id = bb49ca76-b24b-49c0-8fff-36683403f47e response_code = 200 uri = /vpc-routes
25522024-11-22T20:39:59.810ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
25532024-11-22T20:39:59.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49652 req_id = 27739346-3d43-4654-81ff-9abf3a67f2eb response_code = 204 uri = /eip-gateways
25542024-11-22T20:39:59.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49652 req_id = 3f0ecdd7-17e4-4a86-8740-fda9a27c320f response_code = 204 uri = /vpc-routes
25552024-11-22T20:39:59.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62963
25562024-11-22T20:39:59.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62963 req_id = 36e4a73b-235d-4ecd-a440-66a55261067f response_code = 200 uri = /v2p
25572024-11-22T20:39:59.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59917
25582024-11-22T20:39:59.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59917 req_id = 8ca94011-04ea-4da5-8f41-a12c5449e0e4 response_code = 200 uri = /vpc-routes
25592024-11-22T20:39:59.892ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
25602024-11-22T20:39:59.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59917 req_id = c16a3196-a360-44a2-82c4-782a5bc73273 response_code = 204 uri = /eip-gateways
25612024-11-22T20:39:59.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59917 req_id = c0b3729c-135b-4171-8d0b-80e7d543a576 response_code = 204 uri = /vpc-routes
25622024-11-22T20:39:59.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62642
25632024-11-22T20:39:59.984ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25642024-11-22T20:40:00.025ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25652024-11-22T20:40:00.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93426 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62642 req_id = a20b52d5-5ace-4358-842a-940381a0c3d4 response_code = 204 uri = /switch-ports
25662024-11-22T20:40:00.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49592
25672024-11-22T20:40:00.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35771
25682024-11-22T20:40:00.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62642 req_id = 387ec250-e66e-4a2e-be12-27443818c1cf response_code = 200 uri = /network-bootstore-config
25692024-11-22T20:40:00.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49592 req_id = 12e97084-33b5-44bb-af70-0e1e5cab3f81 response_code = 200 uri = /v2p
25702024-11-22T20:40:00.078ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25712024-11-22T20:40:00.116ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25722024-11-22T20:40:00.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61722
25732024-11-22T20:40:00.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61722 req_id = 11c3c649-6ce1-47c9-8874-f46ca954523c response_code = 200 uri = /vpc-routes
25742024-11-22T20:40:00.178ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
25752024-11-22T20:40:00.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61722 req_id = 5e84753c-a195-4f2c-a824-6a7d6c33dd91 response_code = 204 uri = /eip-gateways
25762024-11-22T20:40:00.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103042 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35771 req_id = a766c482-6d9b-4993-b664-1e4e5e52f780 response_code = 204 uri = /switch-ports
25772024-11-22T20:40:00.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35771 req_id = a43af500-7920-4da8-bd9b-156742d207bf response_code = 200 uri = /network-bootstore-config
25782024-11-22T20:40:00.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61722 req_id = f60d6572-faf9-4cf2-96ab-cf6a849c8a77 response_code = 204 uri = /vpc-routes
25792024-11-22T20:40:00.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44293
25802024-11-22T20:40:00.231ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25812024-11-22T20:40:00.269ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25822024-11-22T20:40:00.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93216 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44293 req_id = 6af2b52b-ae1f-4ee9-abc2-4a40c34febbc response_code = 204 uri = /switch-ports
25832024-11-22T20:40:00.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44293 req_id = f9641fc5-d63d-4e20-b6b1-684bafedfc54 response_code = 200 uri = /network-bootstore-config
25842024-11-22T20:40:00.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43957
25852024-11-22T20:40:00.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43957 req_id = fcf68273-3f1e-4d92-b742-14b23301e175 response_code = 200 uri = /v2p
25862024-11-22T20:40:11.811ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58003
25872024-11-22T20:40:11.811ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58003 req_id = 02ffc543-3eab-4263-b173-838c1d6a6f8a response_code = 200 uri = /baseboard
25882024-11-22T20:40:26.396ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7049 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 088c4b9a-7ffb-441a-a706-3b35e475fb58 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
25892024-11-22T20:40:29.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52868
25902024-11-22T20:40:29.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52868 req_id = f79c0775-db94-4a55-aa7d-a10c957ec6cc response_code = 200 uri = /vpc-routes
25912024-11-22T20:40:29.694ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
25922024-11-22T20:40:29.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52868 req_id = 01266894-6a38-46b1-b636-175e48539311 response_code = 204 uri = /eip-gateways
25932024-11-22T20:40:29.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52868 req_id = 8f98e9df-8f02-4cd5-a7bd-1f3c29da5042 response_code = 204 uri = /vpc-routes
25942024-11-22T20:40:29.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55702
25952024-11-22T20:40:29.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55702 req_id = 9f358329-b00b-4101-997f-149521d5db9e response_code = 200 uri = /v2p
25962024-11-22T20:40:29.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43425
25972024-11-22T20:40:29.770ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25982024-11-22T20:40:29.815ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25992024-11-22T20:40:29.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105660 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43425 req_id = 9f6b7f67-70c2-48e7-a5a5-a841d1c450fc response_code = 204 uri = /switch-ports
26002024-11-22T20:40:29.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33966
26012024-11-22T20:40:29.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43425 req_id = a13fc10c-259d-46ee-a128-1a0ba81740e5 response_code = 200 uri = /network-bootstore-config
26022024-11-22T20:40:29.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33966 req_id = d421d2e4-8367-4f9a-9a30-e3f7789cc057 response_code = 200 uri = /vpc-routes
26032024-11-22T20:40:29.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62113
26042024-11-22T20:40:29.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62113 req_id = cfdb14c9-ece4-4ee9-a76b-81c1509ea1cf response_code = 200 uri = /vpc-routes
26052024-11-22T20:40:29.891ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
26062024-11-22T20:40:29.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33966 req_id = 70aec166-b5a2-46d0-8224-01b8911dbfe2 response_code = 204 uri = /eip-gateways
26072024-11-22T20:40:29.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33966 req_id = 26644c62-bc33-4f3a-94bd-d40a3614296d response_code = 204 uri = /vpc-routes
26082024-11-22T20:40:29.928ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
26092024-11-22T20:40:29.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62113 req_id = 91cd7ba0-81c5-405d-8ad0-227765f77c6a response_code = 204 uri = /eip-gateways
26102024-11-22T20:40:29.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38258
26112024-11-22T20:40:29.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38258 req_id = fcc11b02-1f06-4127-9a4b-4f0265ed7d41 response_code = 200 uri = /v2p
26122024-11-22T20:40:29.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62113 req_id = a26e2474-77a6-489b-949e-9c4f387645b7 response_code = 204 uri = /vpc-routes
26132024-11-22T20:40:29.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59049
26142024-11-22T20:40:29.980ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26152024-11-22T20:40:30.017ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26162024-11-22T20:40:30.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92605 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59049 req_id = 68d1e034-60bf-457e-9a7c-0b2a5c1d7623 response_code = 204 uri = /switch-ports
26172024-11-22T20:40:30.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59049 req_id = 7ffa3a38-d815-439d-ad4e-ca0557c945d0 response_code = 200 uri = /network-bootstore-config
26182024-11-22T20:40:30.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62248
26192024-11-22T20:40:30.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62248 req_id = 801470b0-fe50-4fa7-ba6c-5d0f63852d6a response_code = 200 uri = /v2p
26202024-11-22T20:40:30.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42152
26212024-11-22T20:40:30.274ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26222024-11-22T20:40:30.311ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26232024-11-22T20:40:30.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94317 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42152 req_id = a5164d4b-aef6-4aab-9b99-64ecdebd85cb response_code = 204 uri = /switch-ports
26242024-11-22T20:40:30.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42152 req_id = 9c80f568-9fee-43f0-ac9d-0b19c0363779 response_code = 200 uri = /network-bootstore-config
26252024-11-22T20:40:41.845ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61789
26262024-11-22T20:40:41.845ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61789 req_id = 45ff926e-905a-4b8b-b711-ccce9ea24acf response_code = 200 uri = /baseboard
26272024-11-22T20:40:56.395ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7057 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 25cfe308-f535-497d-ab90-2d1ce7e90af3 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
26282024-11-22T20:40:59.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60416
26292024-11-22T20:40:59.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60416 req_id = db9de087-d03b-4054-b976-36c4f8fb753f response_code = 200 uri = /vpc-routes
26302024-11-22T20:40:59.806ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
26312024-11-22T20:40:59.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60416 req_id = cd44e66b-3bfe-474d-aeba-3abfb8e0ca0d response_code = 204 uri = /eip-gateways
26322024-11-22T20:40:59.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48080
26332024-11-22T20:40:59.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48080 req_id = aadd797c-bd6a-49cf-9c5a-d66fc7f3a602 response_code = 200 uri = /v2p
26342024-11-22T20:40:59.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60416 req_id = 514bc6ed-32a4-4b37-901b-967cbd6f1028 response_code = 204 uri = /vpc-routes
26352024-11-22T20:40:59.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64746
26362024-11-22T20:40:59.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64746 req_id = 8395ac5a-ff2b-4f1e-8cfb-aecb04f065d5 response_code = 200 uri = /vpc-routes
26372024-11-22T20:40:59.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39412
26382024-11-22T20:40:59.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26392024-11-22T20:40:59.930ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26402024-11-22T20:41:00.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125010 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39412 req_id = a07eaeb7-5609-4764-81e5-d3c2c63f2e03 response_code = 204 uri = /switch-ports
26412024-11-22T20:41:00.007ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
26422024-11-22T20:41:00.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64746 req_id = ab03464b-7ae0-41e1-88ce-9431a66c5f32 response_code = 204 uri = /eip-gateways
26432024-11-22T20:41:00.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39412 req_id = 2968f018-e857-4fbd-aa85-0584bd7cca63 response_code = 200 uri = /network-bootstore-config
26442024-11-22T20:41:00.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64746 req_id = bf2ce88f-04e9-4508-870b-2b76b64f7316 response_code = 204 uri = /vpc-routes
26452024-11-22T20:41:00.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37289
26462024-11-22T20:41:00.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37289 req_id = 04f564a7-af02-4277-92dd-065ebbb04cef response_code = 200 uri = /vpc-routes
26472024-11-22T20:41:00.073ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
26482024-11-22T20:41:00.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37289 req_id = 4447dc32-7111-4762-889b-4f297bf06a91 response_code = 204 uri = /eip-gateways
26492024-11-22T20:41:00.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37289 req_id = e89aadb9-c73a-474c-aa86-e3b10a06e090 response_code = 204 uri = /vpc-routes
26502024-11-22T20:41:00.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38304
26512024-11-22T20:41:00.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38304 req_id = 90f6cfd4-415c-4f2f-9187-8fb58584ae70 response_code = 200 uri = /v2p
26522024-11-22T20:41:00.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45724
26532024-11-22T20:41:00.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45724 req_id = 53d7befa-87d9-4997-a6bd-6de43e313f60 response_code = 200 uri = /v2p
26542024-11-22T20:41:00.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56816
26552024-11-22T20:41:00.153ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26562024-11-22T20:41:00.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26572024-11-22T20:41:00.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89463 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56816 req_id = 352187fa-892e-4628-be89-dd5b03206d8b response_code = 204 uri = /switch-ports
26582024-11-22T20:41:00.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38646
26592024-11-22T20:41:00.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56816 req_id = 4fd731f6-79a5-4206-b123-fdc33cbdfa3c response_code = 200 uri = /network-bootstore-config
26602024-11-22T20:41:00.243ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26612024-11-22T20:41:00.276ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26622024-11-22T20:41:00.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84418 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38646 req_id = 81a4b25f-80fa-4167-8484-b31f8a2e5386 response_code = 204 uri = /switch-ports
26632024-11-22T20:41:00.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38646 req_id = 3d255356-6f23-46fe-84ac-650175e6ceec response_code = 200 uri = /network-bootstore-config
26642024-11-22T20:41:11.878ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49983
26652024-11-22T20:41:11.878ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49983 req_id = 087de7ff-f5ec-4a29-a86a-32dd6dfc8c01 response_code = 200 uri = /baseboard
26662024-11-22T20:41:26.397ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7542 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 10fe027e-20c1-4e41-a0ef-cc789c69dd25 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
26672024-11-22T20:41:29.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63758
26682024-11-22T20:41:29.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63758 req_id = 457e1ae7-6bbf-4449-8e60-1e26fdd0e01a response_code = 200 uri = /vpc-routes
26692024-11-22T20:41:29.570ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
26702024-11-22T20:41:29.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63758 req_id = fddc14e7-26d6-44de-8077-68348f76038a response_code = 204 uri = /eip-gateways
26712024-11-22T20:41:29.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63758 req_id = 125775c6-a7dc-493f-bebf-2dd76a35fb33 response_code = 204 uri = /vpc-routes
26722024-11-22T20:41:29.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59176
26732024-11-22T20:41:29.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59176 req_id = ada59e9c-90cd-42fe-93e7-6f9aac20ab60 response_code = 200 uri = /v2p
26742024-11-22T20:41:29.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39413
26752024-11-22T20:41:29.723ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26762024-11-22T20:41:29.764ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26772024-11-22T20:41:29.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39413 req_id = ed8b5f40-af9c-44c1-a6ba-ccb6a5139ac4 response_code = 204 uri = /switch-ports
26782024-11-22T20:41:29.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49488
26792024-11-22T20:41:29.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51223
26802024-11-22T20:41:29.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51223 req_id = 5b1dc99a-ab16-4806-8e9f-c4b3cc7de29e response_code = 200 uri = /vpc-routes
26812024-11-22T20:41:29.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49488 req_id = 823eff20-e368-445a-979d-09f6eaead2ec response_code = 200 uri = /vpc-routes
26822024-11-22T20:41:29.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39413 req_id = 34a8308c-3217-421b-9fd7-b8c9467c1636 response_code = 200 uri = /network-bootstore-config
26832024-11-22T20:41:29.866ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
26842024-11-22T20:41:29.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51223 req_id = 1fa32120-b986-4054-8f1e-cfe6af210c43 response_code = 204 uri = /eip-gateways
26852024-11-22T20:41:29.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
26862024-11-22T20:41:29.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49488 req_id = 753cfb5a-38b4-43e2-8b13-0058e4b5a4d2 response_code = 204 uri = /eip-gateways
26872024-11-22T20:41:29.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51223 req_id = 5c31701b-80be-4d56-aba7-cb6d716a4642 response_code = 204 uri = /vpc-routes
26882024-11-22T20:41:29.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49488 req_id = 0dcdce33-deab-499b-bb15-9e72088c5403 response_code = 204 uri = /vpc-routes
26892024-11-22T20:41:29.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59379
26902024-11-22T20:41:29.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59379 req_id = 6690c002-176a-44b7-923b-93105f11d39b response_code = 200 uri = /v2p
26912024-11-22T20:41:29.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60242
26922024-11-22T20:41:29.926ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26932024-11-22T20:41:29.961ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26942024-11-22T20:41:30.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89129 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60242 req_id = 457f23aa-6108-48a2-842e-da1ca391f375 response_code = 204 uri = /switch-ports
26952024-11-22T20:41:30.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34127
26962024-11-22T20:41:30.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49794
26972024-11-22T20:41:30.015ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26982024-11-22T20:41:30.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60242 req_id = a3dcefc2-b18c-43c1-b18c-f66ceb5506c1 response_code = 200 uri = /network-bootstore-config
26992024-11-22T20:41:30.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34127 req_id = a6aef16f-7e54-4e2f-8282-d297072a3ce7 response_code = 200 uri = /v2p
27002024-11-22T20:41:30.051ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27012024-11-22T20:41:30.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90522 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49794 req_id = 5aa8ee4b-15bb-40d1-bd4b-d70a03bf136d response_code = 204 uri = /switch-ports
27022024-11-22T20:41:30.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49794 req_id = 28f61819-5d26-4376-afb2-7c516ad7af48 response_code = 200 uri = /network-bootstore-config
27032024-11-22T20:41:41.910ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33708
27042024-11-22T20:41:41.910ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33708 req_id = 935372ff-b1ae-4ecc-b9bd-df04366ab3c7 response_code = 200 uri = /baseboard
27052024-11-22T20:41:56.396ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7775 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 7850c006-a3d3-41c0-a1d1-8d10c5f8e786 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
27062024-11-22T20:41:59.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40521
27072024-11-22T20:41:59.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40521 req_id = c35b2e2f-b5c3-4a10-9a58-c3c457099b89 response_code = 200 uri = /vpc-routes
27082024-11-22T20:41:59.887ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
27092024-11-22T20:41:59.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40521 req_id = 3f05e4ef-6142-4a79-bca9-806660c30e76 response_code = 204 uri = /eip-gateways
27102024-11-22T20:41:59.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40521 req_id = 9c05ecbc-e6c5-4d5e-9895-b0a21c751e91 response_code = 204 uri = /vpc-routes
27112024-11-22T20:41:59.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61954
27122024-11-22T20:41:59.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61954 req_id = 0dd95318-4e30-43de-b13f-25ddb1bf47b0 response_code = 200 uri = /vpc-routes
27132024-11-22T20:41:59.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47419
27142024-11-22T20:41:59.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47419 req_id = 9c237c7f-aaf6-4bb5-b403-27138640fb03 response_code = 200 uri = /v2p
27152024-11-22T20:42:00.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37200
27162024-11-22T20:42:00.008ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27172024-11-22T20:42:00.054ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27182024-11-22T20:42:00.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37200 req_id = 10c68cd9-b45d-4c0d-8c97-a7f2fda250d1 response_code = 204 uri = /switch-ports
27192024-11-22T20:42:00.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61763
27202024-11-22T20:42:00.122ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
27212024-11-22T20:42:00.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61954 req_id = d6bb43ca-d5e9-4616-a850-0d968f92ae86 response_code = 204 uri = /eip-gateways
27222024-11-22T20:42:00.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37200 req_id = 55c10113-ae9c-4d18-84ce-5eeeb5d2e18a response_code = 200 uri = /network-bootstore-config
27232024-11-22T20:42:00.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27242024-11-22T20:42:00.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27252024-11-22T20:42:00.122ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:178
27262024-11-22T20:42:00.122ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:178
27272024-11-22T20:42:00.137ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27282024-11-22T20:42:00.137ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451
27292024-11-22T20:42:00.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65019
27302024-11-22T20:42:00.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35920
27312024-11-22T20:42:00.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35920 req_id = 1eefacf8-2a59-43ce-a7f5-85de80acd049 response_code = 200 uri = /v2p
27322024-11-22T20:42:00.153ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27332024-11-22T20:42:00.153ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27342024-11-22T20:42:00.153ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:178
27352024-11-22T20:42:00.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 782 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61954 req_id = 37153060-9405-46a3-843e-5ead26590638 response_code = 204 uri = /vpc-routes
27362024-11-22T20:42:00.158ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:178
27372024-11-22T20:42:00.165ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27382024-11-22T20:42:00.165ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8c870c6a-53aa-40e3-8b74-681d946263cd
27392024-11-22T20:42:00.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50398
27402024-11-22T20:42:00.174ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27412024-11-22T20:42:00.180ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27422024-11-22T20:42:00.180ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451
27432024-11-22T20:42:00.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41415
27442024-11-22T20:42:00.205ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27452024-11-22T20:42:00.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27462024-11-22T20:42:00.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27472024-11-22T20:42:00.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27482024-11-22T20:42:00.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27492024-11-22T20:42:00.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27502024-11-22T20:42:00.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27512024-11-22T20:42:00.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 882 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41415 req_id = f59581a1-8797-4646-b16c-d82e9521be59 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27522024-11-22T20:42:00.206ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27532024-11-22T20:42:00.206ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8c870c6a-53aa-40e3-8b74-681d946263cd
27542024-11-22T20:42:00.214ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27552024-11-22T20:42:00.220ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27562024-11-22T20:42:00.220ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26
27572024-11-22T20:42:00.235ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27582024-11-22T20:42:00.235ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26
27592024-11-22T20:42:00.256ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27602024-11-22T20:42:00.257ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e83de9a9-73fc-4157-8f0d-bc628401b262
27612024-11-22T20:42:00.271ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27622024-11-22T20:42:00.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45589
27632024-11-22T20:42:00.272ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e83de9a9-73fc-4157-8f0d-bc628401b262
27642024-11-22T20:42:00.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 447 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45589 req_id = e397dca3-e484-4b91-b775-e890fdcc4c83 response_code = 200 uri = /vpc-routes
27652024-11-22T20:42:00.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107692 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50398 req_id = a8e28a78-b425-4ed9-9bfb-93274b2125f7 response_code = 204 uri = /switch-ports
27662024-11-22T20:42:00.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50398 req_id = b8ad68ac-bc2f-450e-96d1-6b41d11618a8 response_code = 200 uri = /network-bootstore-config
27672024-11-22T20:42:00.299ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
27682024-11-22T20:42:00.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 728 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45589 req_id = 671fa35d-5019-4631-a9f7-0f38e12fad69 response_code = 204 uri = /eip-gateways
27692024-11-22T20:42:00.302ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27702024-11-22T20:42:00.302ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6192e0c0-75f6-422c-9444-5c281ce64c40
27712024-11-22T20:42:00.316ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27722024-11-22T20:42:00.316ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6192e0c0-75f6-422c-9444-5c281ce64c40
27732024-11-22T20:42:00.333ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27742024-11-22T20:42:00.333ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b30200-6d9c-435a-8546-6c099d7abe31
27752024-11-22T20:42:00.345ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27762024-11-22T20:42:00.345ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b30200-6d9c-435a-8546-6c099d7abe31
27772024-11-22T20:42:00.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44914
27782024-11-22T20:42:00.363ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27792024-11-22T20:42:00.363ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27802024-11-22T20:42:00.363ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27812024-11-22T20:42:00.364ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27822024-11-22T20:42:00.364ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27832024-11-22T20:42:00.364ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27842024-11-22T20:42:00.364ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27852024-11-22T20:42:00.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 717 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44914 req_id = 034036d7-2cff-4c2e-8edd-5301af34be83 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27862024-11-22T20:42:00.365ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27872024-11-22T20:42:00.365ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1
27882024-11-22T20:42:00.377ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27892024-11-22T20:42:00.377ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1
27902024-11-22T20:42:00.390ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27912024-11-22T20:42:00.391ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f
27922024-11-22T20:42:00.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56555
27932024-11-22T20:42:00.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56555 req_id = 8c721a16-aeaa-4504-bf0b-fd15d3b9dde8 response_code = 200 uri = /v2p
27942024-11-22T20:42:00.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63803
27952024-11-22T20:42:00.404ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27962024-11-22T20:42:00.404ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f
27972024-11-22T20:42:00.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 399 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45589 req_id = 629c50f7-d8ab-40ac-b36f-dd7d11957623 response_code = 204 uri = /vpc-routes
27982024-11-22T20:42:00.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27992024-11-22T20:42:00.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28002024-11-22T20:42:00.417ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/config/omicron-zones.json file = common/src/ledger.rs:178
28012024-11-22T20:42:00.426ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/config/omicron-zones.json file = common/src/ledger.rs:178
28022024-11-22T20:42:00.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28032024-11-22T20:42:00.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_04456916-263d-47e8-84ad-1a50c9bd09d7
28042024-11-22T20:42:00.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38149
28052024-11-22T20:42:00.441ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28062024-11-22T20:42:00.446ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28072024-11-22T20:42:00.446ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_04456916-263d-47e8-84ad-1a50c9bd09d7
28082024-11-22T20:42:00.459ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28092024-11-22T20:42:00.459ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451
28102024-11-22T20:42:00.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61763 req_id = 534ac51c-90db-41bd-8dae-cde3ffd8e572 response_code = 200 uri = /inventory
28112024-11-22T20:42:00.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336933 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65019 req_id = b6401db3-c8a6-424e-bb89-c6c1596cfa4c response_code = 200 uri = /inventory
28122024-11-22T20:42:00.479ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28132024-11-22T20:42:00.486ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8c870c6a-53aa-40e3-8b74-681d946263cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28142024-11-22T20:42:00.486ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8c870c6a-53aa-40e3-8b74-681d946263cd
28152024-11-22T20:42:00.512ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df43b0c5-92d2-47ba-a7cf-8412d50e2f26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28162024-11-22T20:42:00.512ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_df43b0c5-92d2-47ba-a7cf-8412d50e2f26
28172024-11-22T20:42:00.540ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e83de9a9-73fc-4157-8f0d-bc628401b262 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28182024-11-22T20:42:00.540ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e83de9a9-73fc-4157-8f0d-bc628401b262
28192024-11-22T20:42:00.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103269 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38149 req_id = 24e2a11f-df39-496e-bb79-2387774cfd6f response_code = 204 uri = /switch-ports
28202024-11-22T20:42:00.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38149 req_id = 2926f539-cd1e-43c2-886a-9ff0aa38f507 response_code = 200 uri = /network-bootstore-config
28212024-11-22T20:42:00.567ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6192e0c0-75f6-422c-9444-5c281ce64c40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28222024-11-22T20:42:00.567ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6192e0c0-75f6-422c-9444-5c281ce64c40
28232024-11-22T20:42:00.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56009
28242024-11-22T20:42:00.571ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e40dbe5-c6ea-4aa0-83b9-742671429de5, kind: Service { id: fb1e901a-bcca-493f-ba36-e82914f0ffc4 }, name: Name("external-dns-fb1e901a-bcca-493f-ba36-e82914f0ffc4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 199])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d304b672-4584-4b25-b54e-b9e290f330ef, kind: Service { id: 629b0356-ba24-4504-89b1-926bdda66829 }, name: Name("external-dns-629b0356-ba24-4504-89b1-926bdda66829"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7ae6a6b4-7a13-4f29-890e-5c58643861da, kind: Service { id: 9e5c0409-067b-4d34-9125-c0f4499eea37 }, name: Name("nexus-9e5c0409-067b-4d34-9125-c0f4499eea37"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c85420c9-fe3d-469a-949f-524d1c6a8b3f, kind: Service { id: 267c9b78-f350-4c38-8b20-14a41a3c0693 }, name: Name("nexus-267c9b78-f350-4c38-8b20-14a41a3c0693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3b87486-fbc2-45e4-a576-4a439c88f430, kind: Service { id: e9915dd1-a3eb-4eda-8383-a5528e4ab817 }, name: Name("nexus-e9915dd1-a3eb-4eda-8383-a5528e4ab817"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28252024-11-22T20:42:00.571ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28262024-11-22T20:42:00.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28272024-11-22T20:42:00.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28282024-11-22T20:42:00.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28292024-11-22T20:42:00.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28302024-11-22T20:42:00.572ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28312024-11-22T20:42:00.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 686 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56009 req_id = fc226f04-ec15-484f-b11c-528e1cc4b05f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28322024-11-22T20:42:00.591ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b30200-6d9c-435a-8546-6c099d7abe31 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28332024-11-22T20:42:00.591ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b30200-6d9c-435a-8546-6c099d7abe31
28342024-11-22T20:42:00.613ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d5f676e-00d2-41d0-bdef-829708d70ca1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28352024-11-22T20:42:00.613ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_6d5f676e-00d2-41d0-bdef-829708d70ca1
28362024-11-22T20:42:00.633ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 09d9b394-0398-412b-87f1-761ce2ca9d9f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28372024-11-22T20:42:00.633ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_09d9b394-0398-412b-87f1-761ce2ca9d9f
28382024-11-22T20:42:00.656ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04456916-263d-47e8-84ad-1a50c9bd09d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28392024-11-22T20:42:00.657ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_04456916-263d-47e8-84ad-1a50c9bd09d7
28402024-11-22T20:42:00.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267910 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63803 req_id = 992cbda0-8ddd-4386-a06b-feb645eef1bc response_code = 200 uri = /inventory
28412024-11-22T20:42:11.943ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41636
28422024-11-22T20:42:11.943ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41636 req_id = a3dc4eda-5f42-44f7-ae54-3cc4e257fa47 response_code = 200 uri = /baseboard
28432024-11-22T20:42:26.396ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7992 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = c439ec04-b054-4aa2-8683-abe8e5db6975 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
28442024-11-22T20:42:29.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47694
28452024-11-22T20:42:29.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47694 req_id = 19225921-ea0b-4f51-95f2-5c0b6ce20f83 response_code = 200 uri = /vpc-routes
28462024-11-22T20:42:29.707ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
28472024-11-22T20:42:29.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47694 req_id = ab94519b-53bf-4a51-9c63-c520ecd3aaf6 response_code = 204 uri = /eip-gateways
28482024-11-22T20:42:29.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47694 req_id = a024df72-1efb-4905-9ddc-a4f8b71a4404 response_code = 204 uri = /vpc-routes
28492024-11-22T20:42:29.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52205
28502024-11-22T20:42:29.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28512024-11-22T20:42:29.836ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28522024-11-22T20:42:29.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99113 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52205 req_id = 5693c22c-44a4-435a-bbb3-2024194f1b5c response_code = 204 uri = /switch-ports
28532024-11-22T20:42:29.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48208
28542024-11-22T20:42:29.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52546
28552024-11-22T20:42:29.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63929
28562024-11-22T20:42:29.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52205 req_id = ab52daf6-77fa-4e06-a7e4-e0213b4c0487 response_code = 200 uri = /network-bootstore-config
28572024-11-22T20:42:29.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45973
28582024-11-22T20:42:29.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49548
28592024-11-22T20:42:29.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49548 req_id = 35bdcc1c-7e95-4b79-91bc-45daed20fc82 response_code = 200 uri = /vpc-routes
28602024-11-22T20:42:29.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63929 req_id = d078ddfe-72b9-4d39-a7f6-5bb4940912aa response_code = 200 uri = /v2p
28612024-11-22T20:42:29.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48208 req_id = dbd6d71e-b5db-4884-bffd-e886a30d9d56 response_code = 200 uri = /v2p
28622024-11-22T20:42:29.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52546 req_id = d6bf7ec7-1c19-4962-8971-6f67ddf66035 response_code = 200 uri = /vpc-routes
28632024-11-22T20:42:29.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45973 req_id = aab8cb29-ba51-4df2-a90f-97fd5e11f985 response_code = 200 uri = /v2p
28642024-11-22T20:42:29.916ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
28652024-11-22T20:42:29.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49548 req_id = b180c331-cd5a-47e7-aaa0-eb1ec695ce08 response_code = 204 uri = /eip-gateways
28662024-11-22T20:42:29.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49548 req_id = 708921c6-1375-4c19-bf2a-c3d11e14a1b8 response_code = 204 uri = /vpc-routes
28672024-11-22T20:42:29.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37004
28682024-11-22T20:42:29.938ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28692024-11-22T20:42:29.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28702024-11-22T20:42:30.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93919 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37004 req_id = bc64948c-9737-43a0-9d9a-29ee75f04411 response_code = 204 uri = /switch-ports
28712024-11-22T20:42:30.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41498
28722024-11-22T20:42:30.032ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
28732024-11-22T20:42:30.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52546 req_id = b364c5da-c6ba-4590-b101-be6fbbbeabb0 response_code = 204 uri = /eip-gateways
28742024-11-22T20:42:30.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37004 req_id = 1226db24-fd2b-483e-ba28-ec45f2d6e6ce response_code = 200 uri = /network-bootstore-config
28752024-11-22T20:42:30.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28762024-11-22T20:42:30.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 384 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52546 req_id = 722a47d4-a481-4492-8b7d-59ce9df3b951 response_code = 204 uri = /vpc-routes
28772024-11-22T20:42:30.068ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28782024-11-22T20:42:30.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89984 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41498 req_id = 9ed412f2-af0b-4882-9a8a-903c35468cbe response_code = 204 uri = /switch-ports
28792024-11-22T20:42:30.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41498 req_id = 144fdf70-f362-475a-933a-68d7084b83fe response_code = 200 uri = /network-bootstore-config
28802024-11-22T20:42:34.873ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
28812024-11-22T20:42:41.976ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54778
28822024-11-22T20:42:41.977ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54778 req_id = a723786d-5ad3-47c8-a923-268f9cf2b14f response_code = 200 uri = /baseboard
28832024-11-22T20:42:56.396ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7885 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 0b2959f6-d286-4a5f-b110-bb7903e0b58a response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
28842024-11-22T20:42:59.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53519
28852024-11-22T20:42:59.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53519 req_id = 22bf43be-c869-4ee9-8ded-a11aa37ce66f response_code = 200 uri = /vpc-routes
28862024-11-22T20:42:59.713ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
28872024-11-22T20:42:59.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53519 req_id = c4065932-6fa6-43ba-9dc1-2b9d78f32423 response_code = 204 uri = /eip-gateways
28882024-11-22T20:42:59.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53519 req_id = 6d81298e-9993-46a1-afa2-3cadfe68fa54 response_code = 204 uri = /vpc-routes
28892024-11-22T20:42:59.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60962
28902024-11-22T20:42:59.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60962 req_id = 4fe67626-1974-49a4-8edc-920cef3b919a response_code = 200 uri = /vpc-routes
28912024-11-22T20:42:59.951ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
28922024-11-22T20:42:59.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60962 req_id = f49e9dca-9f21-43e2-b2a6-35e4d63bb31a response_code = 204 uri = /eip-gateways
28932024-11-22T20:42:59.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38694
28942024-11-22T20:42:59.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38694 req_id = fc9d54ef-b588-4c5d-a76f-195e0ee2130f response_code = 200 uri = /v2p
28952024-11-22T20:42:59.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60962 req_id = 3cc557f7-5786-4fff-9a12-574f2389aaee response_code = 204 uri = /vpc-routes
28962024-11-22T20:42:59.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51050
28972024-11-22T20:42:59.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51050 req_id = 51dc89e1-401e-4b08-8195-99acb92eea8c response_code = 200 uri = /vpc-routes
28982024-11-22T20:42:59.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60431
28992024-11-22T20:42:59.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60431 req_id = 473f74dc-9306-4e24-b29e-26d8c3c45bba response_code = 200 uri = /v2p
29002024-11-22T20:43:00.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
29012024-11-22T20:43:00.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51050 req_id = 9d037624-9bdc-4d27-80cd-db8007709a9f response_code = 204 uri = /eip-gateways
29022024-11-22T20:43:00.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51050 req_id = db26c569-74d0-4855-8981-9ed4bc14c4e1 response_code = 204 uri = /vpc-routes
29032024-11-22T20:43:00.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42317
29042024-11-22T20:43:00.025ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29052024-11-22T20:43:00.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29062024-11-22T20:43:00.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97809 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42317 req_id = 0adda3eb-1c72-4934-89e6-b0de5ce2fd66 response_code = 204 uri = /switch-ports
29072024-11-22T20:43:00.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58705
29082024-11-22T20:43:00.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29092024-11-22T20:43:00.157ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29102024-11-22T20:43:00.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88800 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58705 req_id = 87f99d92-7793-44bd-b1ba-06b6b572e441 response_code = 204 uri = /switch-ports
29112024-11-22T20:43:00.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55831
29122024-11-22T20:43:00.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50561
29132024-11-22T20:43:00.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58705 req_id = ec6f8daa-efd4-4baa-9c62-340dd7053443 response_code = 200 uri = /network-bootstore-config
29142024-11-22T20:43:00.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42317 req_id = 690be1c7-66fa-45f8-98b2-ea9706f47f03 response_code = 200 uri = /network-bootstore-config
29152024-11-22T20:43:00.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29162024-11-22T20:43:00.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55831 req_id = 0e88e4a5-83a8-45ca-bc2a-6279e535fe29 response_code = 200 uri = /v2p
29172024-11-22T20:43:00.250ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29182024-11-22T20:43:00.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97011 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50561 req_id = 081ed525-e13b-4c6c-9e66-1103345fa934 response_code = 204 uri = /switch-ports
29192024-11-22T20:43:00.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50561 req_id = 895370ca-b2c5-4e5d-b2b7-110f2a323ad4 response_code = 200 uri = /network-bootstore-config
29202024-11-22T20:43:12.009ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43463
29212024-11-22T20:43:12.010ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43463 req_id = c458449b-d4ae-4853-bac2-0961465cb11c response_code = 200 uri = /baseboard
29222024-11-22T20:43:26.395ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7152 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 317ab0e5-b4c9-48ed-a634-61602ed02651 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
29232024-11-22T20:43:29.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52600
29242024-11-22T20:43:29.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52600 req_id = 11885d6d-a385-4645-8ae8-3b489a473e38 response_code = 200 uri = /v2p
29252024-11-22T20:43:29.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43720
29262024-11-22T20:43:29.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43720 req_id = bfc8a8da-2b9b-4ba1-8fb3-f29f70d65d7a response_code = 200 uri = /vpc-routes
29272024-11-22T20:43:29.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
29282024-11-22T20:43:29.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43720 req_id = 91ce1d61-0f17-4d20-be39-c5629e2e195a response_code = 204 uri = /eip-gateways
29292024-11-22T20:43:29.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43720 req_id = afb17873-d0f2-4d91-b038-08c8a86a3a55 response_code = 204 uri = /vpc-routes
29302024-11-22T20:43:29.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37691
29312024-11-22T20:43:29.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37691 req_id = 29261315-a063-4aeb-8a13-ca68b25809de response_code = 200 uri = /vpc-routes
29322024-11-22T20:43:29.764ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
29332024-11-22T20:43:29.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37691 req_id = af817f36-a0ca-49a0-a5dd-a14eb348e2a0 response_code = 204 uri = /eip-gateways
29342024-11-22T20:43:29.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37691 req_id = ed4d0889-a844-4877-aab4-ced0f78c982a response_code = 204 uri = /vpc-routes
29352024-11-22T20:43:29.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58843
29362024-11-22T20:43:29.776ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29372024-11-22T20:43:29.823ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29382024-11-22T20:43:29.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58843 req_id = 45bd8dd0-2bc2-464e-b6f4-f3524ad6178e response_code = 204 uri = /switch-ports
29392024-11-22T20:43:29.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52288
29402024-11-22T20:43:29.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60051
29412024-11-22T20:43:29.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58843 req_id = a1a887d1-91a5-4601-a993-035bdbf69cb6 response_code = 200 uri = /network-bootstore-config
29422024-11-22T20:43:29.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52288 req_id = 489eb791-763a-4d9b-8b5b-350ce4bbff5d response_code = 200 uri = /vpc-routes
29432024-11-22T20:43:29.889ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29442024-11-22T20:43:29.909ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
29452024-11-22T20:43:29.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 640 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52288 req_id = 1860f1e5-3528-4e44-81a3-046d38ff0a91 response_code = 204 uri = /eip-gateways
29462024-11-22T20:43:29.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52288 req_id = baa66cdb-8df2-49c8-b7c7-8a0ce5a8e041 response_code = 204 uri = /vpc-routes
29472024-11-22T20:43:29.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55651
29482024-11-22T20:43:29.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55651 req_id = bbee6bab-baaf-4f5d-a930-30271081f006 response_code = 200 uri = /v2p
29492024-11-22T20:43:29.932ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29502024-11-22T20:43:29.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41551
29512024-11-22T20:43:29.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41551 req_id = 68cf521d-6091-43b1-804c-97955c673084 response_code = 200 uri = /v2p
29522024-11-22T20:43:29.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34183
29532024-11-22T20:43:29.992ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29542024-11-22T20:43:29.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103471 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60051 req_id = c63847a2-ab51-41db-9219-af41a86b3309 response_code = 204 uri = /switch-ports
29552024-11-22T20:43:29.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60051 req_id = 1ef54b8d-2412-46ef-9b54-2856ed40b194 response_code = 200 uri = /network-bootstore-config
29562024-11-22T20:43:30.031ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29572024-11-22T20:43:30.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34183 req_id = 962034d2-bc46-494b-bd73-0cd21e7a6073 response_code = 204 uri = /switch-ports
29582024-11-22T20:43:30.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34183 req_id = 4508b500-d136-4a59-9cad-40de7c411a04 response_code = 200 uri = /network-bootstore-config
29592024-11-22T20:43:42.042ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51738
29602024-11-22T20:43:42.042ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51738 req_id = adec3874-e4a3-49b7-927a-75380250ef33 response_code = 200 uri = /baseboard
29612024-11-22T20:43:45.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63383
29622024-11-22T20:43:45.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63383 req_id = 11746704-db77-4860-83fd-c972a094c317 response_code = 200 uri = /v2p
29632024-11-22T20:43:45.544ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(4914364) }
29642024-11-22T20:43:45.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 668 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63383 req_id = 8909d1b9-b5f1-422a-a21f-78732f53d7a7 response_code = 204 uri = /v2p
29652024-11-22T20:43:45.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53556
29662024-11-22T20:43:45.676ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: f0e53f9f-67b9-41ec-9893-dc739e3b7785, kind: Instance { id: 3905294d-57a2-42c0-ba97-d4439f18f998 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4914364), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f0e53f9f-67b9-41ec-9893-dc739e3b7785, kind: Instance { id: 3905294d-57a2-42c0-ba97-d4439f18f998 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4914364), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f0e53f9f-67b9-41ec-9893-dc739e3b7785, kind: Instance { id: 3905294d-57a2-42c0-ba97-d4439f18f998 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4914364), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4914364))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f0e53f9f-67b9-41ec-9893-dc739e3b7785, kind: Instance { id: 3905294d-57a2-42c0-ba97-d4439f18f998 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4914364), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-e6fedc16cdd", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 2964e49d-1ec7-48a9-b3f3-6ad380191363, read_only_parent: Some(Volume { block_size: 512, id: 61636809-63df-408f-8680-2e735d9338dc, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 253ee420-b649-4cdd-aec0-7e62aca18b55, key: Some("gXSa458cNF8guAnzYyFoKbC/nq5ebAtdxAF6TfSt1J0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2964e49d-1ec7-48a9-b3f3-6ad380191363, key: Some("HdVvAAX2h3olKxAzanljaope2PVH8Ps2s+/wLiHbBKU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19000", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-e6fedc16cdd" }] }), cloud_init_bytes: Some(..) } instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 metadata = InstanceMetadata { silo_id: aaf5ed0c-4a75-441a-b773-ee550f7eb07b, project_id: b4a8a1c8-20d3-489a-b267-8843f9f95401 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-22T20:43:45.667867198Z }
29672024-11-22T20:43:45.676ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 migration_id = None propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29682024-11-22T20:43:45.676ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 migration_id = None propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: f0e53f9f-67b9-41ec-9893-dc739e3b7785, kind: Instance { id: 3905294d-57a2-42c0-ba97-d4439f18f998 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4914364), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f0e53f9f-67b9-41ec-9893-dc739e3b7785, kind: Instance { id: 3905294d-57a2-42c0-ba97-d4439f18f998 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4914364), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f0e53f9f-67b9-41ec-9893-dc739e3b7785, kind: Instance { id: 3905294d-57a2-42c0-ba97-d4439f18f998 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4914364), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4914364))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f0e53f9f-67b9-41ec-9893-dc739e3b7785, kind: Instance { id: 3905294d-57a2-42c0-ba97-d4439f18f998 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4914364), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-e6fedc16cdd", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 2964e49d-1ec7-48a9-b3f3-6ad380191363, read_only_parent: Some(Volume { block_size: 512, id: 61636809-63df-408f-8680-2e735d9338dc, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 253ee420-b649-4cdd-aec0-7e62aca18b55, key: Some("gXSa458cNF8guAnzYyFoKbC/nq5ebAtdxAF6TfSt1J0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2964e49d-1ec7-48a9-b3f3-6ad380191363, key: Some("HdVvAAX2h3olKxAzanljaope2PVH8Ps2s+/wLiHbBKU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19000", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-e6fedc16cdd" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-22T20:43:45.667867198Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29692024-11-22T20:43:45.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53556 req_id = e918747d-0c43-4a00-bcee-e9ba3bf864e0 response_code = 200 uri = /vmms/e6464e93-ef1d-4ff9-b4bc-e90119b70569
29702024-11-22T20:43:45.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47086
29712024-11-22T20:43:45.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47086 req_id = 98c93fc3-a4d5-4803-9ff1-4e1ef2ea0036 response_code = 200 uri = /vmms/e6464e93-ef1d-4ff9-b4bc-e90119b70569/state
29722024-11-22T20:43:45.767ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 4914364 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29732024-11-22T20:43:45.767ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29742024-11-22T20:43:45.806ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569 file = illumos-utils/src/zone.rs:325 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29752024-11-22T20:43:45.829ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569 file = illumos-utils/src/zone.rs:363 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29762024-11-22T20:43:45.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52258
29772024-11-22T20:43:45.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52258 req_id = ab5f6a18-6c9c-4ae0-8473-be73600568ac response_code = 200 uri = /vpc-routes
29782024-11-22T20:43:45.855ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {f0e53f9f-67b9-41ec-9893-dc739e3b7785: {10.151.2.175: {ddc3f14a-c214-416a-a9a7-eef2e362e2f5}, 10.151.2.176: {ddc3f14a-c214-416a-a9a7-eef2e362e2f5}}} }
29792024-11-22T20:43:47.473ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29802024-11-22T20:43:47.473ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 zone = oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569
29812024-11-22T20:43:47.662ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 71.213403ms file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 zone = oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569
29822024-11-22T20:43:47.749ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 55.395609ms file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 zone = oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569
29832024-11-22T20:43:47.822ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 119.837881ms file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 zone = oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569
29842024-11-22T20:43:47.955ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 241.888384ms file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 zone = oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569
29852024-11-22T20:43:48.213ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 1.079432563s file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 zone = oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569
29862024-11-22T20:43:49.307ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 1.479707618s file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 zone = oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569
29872024-11-22T20:43:50.796ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 676.826235ms file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 zone = oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569
29882024-11-22T20:43:51.484ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 1.252750661s file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 zone = oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569
29892024-11-22T20:43:52.766ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569 file = sled-agent/src/instance.rs:1787 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29902024-11-22T20:43:52.775ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 49.9051ms file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29912024-11-22T20:43:52.835ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 95.429249ms file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29922024-11-22T20:43:52.939ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569") failed: Property not found. retry in 162.4169ms file = illumos-utils/src/svc.rs:36 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29932024-11-22T20:43:53.111ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29942024-11-22T20:43:53.153ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29952024-11-22T20:43:53.296ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29962024-11-22T20:43:53.299ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
29972024-11-22T20:43:53.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7446803 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52258 req_id = d8d9670c-4cb6-48ff-a846-50dac5280991 response_code = 204 uri = /eip-gateways
29982024-11-22T20:43:53.301ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-22T20:43:53.301279035Z } file = sled-agent/src/instance.rs:780 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
29992024-11-22T20:43:53.301ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-22T20:43:53.301279035Z } propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30002024-11-22T20:43:53.301ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-22T20:43:53.301279035Z }, migration_in: None, migration_out: None }
30012024-11-22T20:43:53.331ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-22T20:43:53.331698018Z } file = sled-agent/src/instance.rs:780 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30022024-11-22T20:43:53.331ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-22T20:43:53.331698018Z } propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30032024-11-22T20:43:53.331ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-22T20:43:53.331698018Z }, migration_in: None, migration_out: None }
30042024-11-22T20:43:53.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52258 req_id = 6b7c1493-a91b-403c-8f8c-39efae838d06 response_code = 204 uri = /vpc-routes
30052024-11-22T20:43:56.428ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6976 local_addr = [fd00:1122:3344:101::1]:57404 method = GET remote_addr = [fd00:1122:3344:101::d]:36383 req_id = 01f5ae30-d47b-4c39-bdc0-a88c920ed903 response_code = 200 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 uri = /714aeaa4-2ee3-4359-b59d-b4bb953043b4
30062024-11-22T20:43:59.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63372
30072024-11-22T20:43:59.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63372 req_id = 9cc6ba73-a548-4268-846c-cc542bc3bcd0 response_code = 200 uri = /vmms/e6464e93-ef1d-4ff9-b4bc-e90119b70569/state
30082024-11-22T20:43:59.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41327
30092024-11-22T20:43:59.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41327 req_id = 123e92e3-256b-41e6-9b84-f8a74f9278be response_code = 200 uri = /vpc-routes
30102024-11-22T20:43:59.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52369
30112024-11-22T20:43:59.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52369 req_id = c214265a-c9d4-4841-a658-58b3a54613a2 response_code = 200 uri = /vmms/e6464e93-ef1d-4ff9-b4bc-e90119b70569/state
30122024-11-22T20:43:59.874ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {f0e53f9f-67b9-41ec-9893-dc739e3b7785: {10.151.2.176: {ddc3f14a-c214-416a-a9a7-eef2e362e2f5}, 10.151.2.175: {ddc3f14a-c214-416a-a9a7-eef2e362e2f5}}} }
30132024-11-22T20:43:59.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41327 req_id = 24f24e37-8e91-4b7a-95a6-fb7d1be0e39a response_code = 204 uri = /eip-gateways
30142024-11-22T20:43:59.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39000
30152024-11-22T20:43:59.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39000 req_id = 12b9a9de-2c5a-4b55-aac4-867d3ab3538d response_code = 200 uri = /v2p
30162024-11-22T20:43:59.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41327 req_id = 0ed45482-b2ba-4b93-bdfa-62819087b25b response_code = 204 uri = /vpc-routes
30172024-11-22T20:43:59.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57161
30182024-11-22T20:43:59.951ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
30192024-11-22T20:44:00.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
30202024-11-22T20:44:00.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111810 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57161 req_id = cc97d030-f5ba-4176-8bfd-38fb0e0da3f3 response_code = 204 uri = /switch-ports
30212024-11-22T20:44:00.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54533
30222024-11-22T20:44:00.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41196
30232024-11-22T20:44:00.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57161 req_id = c5bd4bc9-a63d-4382-bd52-a31ffa0eb4b7 response_code = 200 uri = /network-bootstore-config
30242024-11-22T20:44:00.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54533 req_id = 86780054-e77b-400c-96c1-96258b5af6bb response_code = 200 uri = /vpc-routes
30252024-11-22T20:44:00.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41196 req_id = 7b43400c-08b2-411c-b00a-25554c922442 response_code = 200 uri = /vmms/e6464e93-ef1d-4ff9-b4bc-e90119b70569/state
30262024-11-22T20:44:00.080ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {f0e53f9f-67b9-41ec-9893-dc739e3b7785: {10.151.2.175: {ddc3f14a-c214-416a-a9a7-eef2e362e2f5}, 10.151.2.176: {ddc3f14a-c214-416a-a9a7-eef2e362e2f5}}} }
30272024-11-22T20:44:00.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54533 req_id = 3c89a407-1de3-407d-8a94-2775393e8bd9 response_code = 204 uri = /eip-gateways
30282024-11-22T20:44:00.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43528
30292024-11-22T20:44:00.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43528 req_id = e33cb9f9-3a21-454c-a1ab-efd666d6bd7a response_code = 200 uri = /vpc-routes
30302024-11-22T20:44:00.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57683
30312024-11-22T20:44:00.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57683 req_id = 1cc86e81-f22d-4465-864f-fb28c08ce7c5 response_code = 200 uri = /v2p
30322024-11-22T20:44:00.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54533 req_id = 0fea3848-535e-4635-a06d-3ca92154a4b9 response_code = 204 uri = /vpc-routes
30332024-11-22T20:44:00.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56091
30342024-11-22T20:44:00.114ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
30352024-11-22T20:44:00.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
30362024-11-22T20:44:00.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101029 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56091 req_id = 683c81d6-2518-4538-8804-339a35e0967e response_code = 204 uri = /switch-ports
30372024-11-22T20:44:00.215ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {f0e53f9f-67b9-41ec-9893-dc739e3b7785: {10.151.2.176: {ddc3f14a-c214-416a-a9a7-eef2e362e2f5}, 10.151.2.175: {ddc3f14a-c214-416a-a9a7-eef2e362e2f5}}} }
30382024-11-22T20:44:00.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43528 req_id = 48bcf512-e464-4281-8010-59cfa5a70bc9 response_code = 204 uri = /eip-gateways
30392024-11-22T20:44:00.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56091 req_id = f47eb72e-84ca-41ff-9cde-4dece4dac583 response_code = 200 uri = /network-bootstore-config
30402024-11-22T20:44:00.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59215
30412024-11-22T20:44:00.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59215 req_id = 65910ff7-166a-4cd3-a06d-2699f687286f response_code = 200 uri = /v2p
30422024-11-22T20:44:00.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43528 req_id = e5e1d905-8a2d-4ce8-b742-648d4ce9ecdb response_code = 204 uri = /vpc-routes
30432024-11-22T20:44:00.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40913
30442024-11-22T20:44:00.309ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
30452024-11-22T20:44:00.345ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
30462024-11-22T20:44:00.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40913 req_id = fda99a9d-a03c-4c29-b075-1efa712e0284 response_code = 204 uri = /switch-ports
30472024-11-22T20:44:00.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40913 req_id = 1cbd15e0-1eb6-4a2e-88bf-8cf2745ffdbd response_code = 200 uri = /network-bootstore-config
30482024-11-22T20:44:03.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56742
30492024-11-22T20:44:03.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 588 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56742 req_id = 8d7ebcc4-228b-4342-af86-59bd0ef34cb2 response_code = 200 uri = /vmms/e6464e93-ef1d-4ff9-b4bc-e90119b70569/state
30502024-11-22T20:44:03.268ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-22T20:44:03.268540579Z } file = sled-agent/src/instance.rs:780 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30512024-11-22T20:44:03.268ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-22T20:44:03.268540579Z } propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30522024-11-22T20:44:03.268ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-22T20:44:03.268540579Z }, migration_in: None, migration_out: None }
30532024-11-22T20:44:03.293ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-22T20:44:03.293882218Z } file = sled-agent/src/instance.rs:780 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30542024-11-22T20:44:03.293ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-22T20:44:03.293882218Z } propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30552024-11-22T20:44:03.293ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30562024-11-22T20:44:03.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30572024-11-22T20:44:03.294ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30582024-11-22T20:44:03.294ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 7872794655227195034 n_samples = 6 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
30592024-11-22T20:44:03.294ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 8848531765864173360 n_samples = 6 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
30602024-11-22T20:44:03.294ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/058a0e77-cb12-4f9b-aca7-8d6329f3077f/debug/bundle/zone", "/pool/int/5b2602eb-7e15-49ac-949a-e1f7df8df0ca/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/dcd1bfe3-9f4d-4a79-8ab7-1dc0c6900451/crypt/debug", "/pool/ext/8c870c6a-53aa-40e3-8b74-681d946263cd/crypt/debug", "/pool/ext/df43b0c5-92d2-47ba-a7cf-8412d50e2f26/crypt/debug", "/pool/ext/e83de9a9-73fc-4157-8f0d-bc628401b262/crypt/debug", "/pool/ext/6192e0c0-75f6-422c-9444-5c281ce64c40/crypt/debug", "/pool/ext/48b30200-6d9c-435a-8546-6c099d7abe31/crypt/debug", "/pool/ext/6d5f676e-00d2-41d0-bdef-829708d70ca1/crypt/debug", "/pool/ext/09d9b394-0398-412b-87f1-761ce2ca9d9f/crypt/debug", "/pool/ext/04456916-263d-47e8-84ad-1a50c9bd09d7/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569
30612024-11-22T20:44:03.922ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569", bundle_id: 6c7186f2-cabe-4bda-ac2a-edb4b5af2458 }, time_created: 2024-11-22T20:44:03.295083177Z, version: 0, cause: TerminatedInstance }
30622024-11-22T20:44:03.922ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_e6464e93-ef1d-4ff9-b4bc-e90119b70569 file = sled-agent/src/instance.rs:1032 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30632024-11-22T20:44:05.671ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30642024-11-22T20:44:05.685ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(4914364), kind: System }
30652024-11-22T20:44:05.685ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(4914364), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30662024-11-22T20:44:05.686ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-22T20:44:05.686205412Z }, migration_in: None, migration_out: None }
30672024-11-22T20:44:05.741ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-22T20:44:05.686205412Z }, migration_in: None, migration_out: None }
30682024-11-22T20:44:05.745ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 3905294d-57a2-42c0-ba97-d4439f18f998 propolis_id = e6464e93-ef1d-4ff9-b4bc-e90119b70569
30692024-11-22T20:44:06.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52778
30702024-11-22T20:44:06.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52778 req_id = 723e0450-3d8e-4d74-b236-eccf2c272ba0 response_code = 200 uri = /vpc-routes
30712024-11-22T20:44:06.178ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {f0e53f9f-67b9-41ec-9893-dc739e3b7785: {10.151.2.175: {ddc3f14a-c214-416a-a9a7-eef2e362e2f5}, 10.151.2.176: {ddc3f14a-c214-416a-a9a7-eef2e362e2f5}}} }
30722024-11-22T20:44:06.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52778 req_id = 2e983fcd-86ec-49dd-9c4c-9d29626309c0 response_code = 204 uri = /eip-gateways
30732024-11-22T20:44:06.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52778 req_id = cfd5dc35-5630-4244-8262-7da5d1e0bf8a response_code = 204 uri = /vpc-routes
30742024-11-22T20:44:06.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59333
30752024-11-22T20:44:06.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59333 req_id = 60426896-9b23-427d-b66f-6f79b87baeec response_code = 200 uri = /v2p
30762024-11-22T20:44:06.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60388
30772024-11-22T20:44:06.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60388 req_id = 33a85c52-4e85-4e72-8ef6-4003da04a7a0 response_code = 200 uri = /v2p
30782024-11-22T20:44:06.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41401
30792024-11-22T20:44:06.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41401 req_id = ee6fae4a-1ab1-426c-bd03-a1ecc8437242 response_code = 200 uri = /vpc-routes
30802024-11-22T20:44:06.717ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
30812024-11-22T20:44:06.717ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4
30822024-11-22T20:44:06.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41401 req_id = 818c059b-e17f-47eb-a69b-bb2c50c83450 response_code = 204 uri = /eip-gateways
30832024-11-22T20:44:06.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41401 req_id = f8d6c8d3-4e61-4d09-9adf-7337cef6b145 response_code = 204 uri = /vpc-routes
30842024-11-22T20:44:07.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57367
30852024-11-22T20:44:07.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57367 req_id = 814d7012-7132-44db-a497-b539f235f17d response_code = 200 uri = /vpc-routes
30862024-11-22T20:44:07.408ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 714aeaa4-2ee3-4359-b59d-b4bb953043b4 values = ExternalIpGatewayMap { mappings: {} }
30872024-11-22T20:44:07.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57367 req_id = db2c23ce-2d45-4c1a-807d-1d779fd4cc59 response_code = 204 uri = /eip-gateways
30882024-11-22T20:44:07.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57367 req_id = 627f76c7-a7ac-43f0-b45b-2b3b9b1c6b65 response_code = 204 uri = /vpc-routes